Skip to main content

Flexible, wireless skin interface could restore amputees’ sense of touch

New tech gives VR a human touch

VR hardware tends to focus on using a headset to convey visual and auditory information, giving users a realistic experience of virtually generated sights and sounds. But what about another equally important sensation — touch? With the right technology, tactile sensation technology could let people virtually hold hands from across the globe, experience full-body VR immersion, or even restore a sense of touch to those who have lost a limb.

A new paper published today in Nature describes how this is possible through a new type of flexible, wireless interface that can communicate touch information via the skin. The researchers call it “epidermal VR.”

Related Videos

Professor and lead researcher John Rogers of Northwestern University told Digital Trends about how the technology works and how it is already being used by amputees to improve their quality of life.

How epidermal VR works

Diagram showing the layers of the VR patch which allow the transmission of information as vibrations. The copper-colored layer in the middle represents the wireless power circuits containing the electronic components. Northwestern University

The basis for the system is a flexible wireless patch that is 15 by 15 centimeters in size. Slim and soft like a sheet, the patch can be comfortably worn on various areas of the body as it drapes over curves and does not require wires or a battery.

Embedded within the patch is an array of 32 tiny actuators, each of which can vibrate individually. The patch is linked to a touchscreen interface on a smartphone or tablet, and users can use their fingers to touch the screen in any pattern. This touch is detected by the interface and transmitted to the actuators in the patch, which vibrate in a pattern corresponding to the touch.

Similar ideas have been developed in the past, but they have been limited by bulky battery packs or tethering wires. The Northwestern team used their expertise in wireless power transfer to do away with the wires and drew on their previous work in stretchable electronics to create a patch that was flexible and comfortable to wear.

To transfer a feeling of touch from the interface to the flexible patch, both data and power need to be transmitted. For this purpose, the team used a technology that will be more familiar as part of a smartphone. “We use near-field communication (NFC) protocols, i.e., the same type of technology used in smartphones for wireless payments,” Rogers explained. “This interface supports both real-time digital control and power delivery.”

Restoring a sense of touch

Retired U.S. Army Sgt. Garrett Anderson shakes the hand of Aadeel Akhtar, one of the researchers who developed the new VR system. The patch on Anderson’s upper arm allows him to feel transmitted sensations from his prosthetic fingertips. Northwestern University

One of the most remarkable applications of the technology is helping amputees to experience a sense of touch from their missing limbs. The system was tested out by retired U.S. Army Sgt. Garrett Anderson, who lost his arm while serving in Iraq.

The researchers put the flexible patch on Anderson’s upper arm, where he could feel the vibrations, and connected it wirelessly to sensors on the fingertips of his prosthetic arm. He could then feel feedback from his prosthetic fingers in his upper arm, with stronger vibrations indicating a firmer grip and gentler vibrations indicating a looser grip.

This system has immediate tangible benefits for people such as Anderson who need sensory information from their prostheses to interact with objects. “Say that I’m grabbing an egg or something fragile,” Anderson said in a statement. “If I can’t adjust my grip, then I might crush the egg. I need to know the amount of grip that I’m applying, so that I don’t hurt something or someone.”

The benefits aren’t just practical though. There’s an enormous psychological benefit in being able to experience the touch of family and loved ones. “My kids are 13 and 10, so I have never felt them with my right arm,” Anderson said. “I don’t know what it’s like when they grab my right hand.”

Making the system work for more people

Anderson grabs and grips an object while wearing Northwestern’s wireless patch. Northwestern University

The experience isn’t exactly like having your old sense of touch back, Rogers explains, due to differences in how densely packed sensory receptors are in different areas of the body. “The density of sensory receptors in the skin of the upper arm is much lower than that in the fingertips, such that the recreation of the sensation of finger-touch can only be approximate,” he said. “But in most cases, the sensory inputs to the arm can equal the number of sensors on even the most sophisticated prosthetic fingertips.”

It takes some time for users to learn the connection between the sensations from the device — in this case, from the upper arm — and the sensory information being transmitted — in this case, from the fingertips. Eventually, after using the device regularly, the brain begins to recognize sensations in the arm and converts them to an equivalent sensation of touch.

Exactly how long this process of adaptation takes will vary between users, Rogers predicts. “The ability of someone to use the information is very dependent on the individual, and we don’t — at the present time — have data on sufficient numbers of patients to make statements on the time frames,” he said. The group will continue to work on making the system available to more people to see how different individuals respond and adapt to the information.

The technology may even be able to help those who experience phantom pain in their amputated limb, by replacing the phantom sensations with external sensations instead.

Future applications

In the future, the system could be adapted for everything from full-body suits for a totally immersive VR experience to adding a sense of touch to video calls. Rogers says his team has worked to make the system easy for others to scale up for different functions.

“We’ve tried to design the systems — the architecture, the components, the assembly processes, the materials, etc. — to be scalable by retaining alignment with the types of manufacturing capabilities that are used in conventional consumer gadgetry,” Rogers said. This means that companies or other groups can take the concepts the team has developed and adapt them to different commercial or research needs.

For now, the Northwestern group will continue working on improving the actuators in the system and making the device even slimmer and lighter. They are also interested in adapting the system to detect and transmit information about different sensory modalities such as temperature and shear forces. Eventually, the system could be used by people like Anderson to feel not only touch but to detect heat and stretching sensations as well.

Editors' Recommendations

The next big thing in science is already in your pocket
A researcher looks at a protein diagram on his monitor

Supercomputers are an essential part of modern science. By crunching numbers and performing calculations that would take eons for us humans to complete by ourselves, they help us do things that would otherwise be impossible, like predicting hurricane flight paths, simulating nuclear disasters, or modeling how experimental drugs might effect human cells. But that computing power comes at a price -- literally. Supercomputer-dependent research is notoriously expensive. It's not uncommon for research institutions to pay upward of $1,000 for a single hour of supercomputer use, and sometimes more, depending on the hardware that's required.

But lately, rather than relying on big, expensive supercomputers, more and more scientists are turning to a different method for their number-crunching needs: distributed supercomputing. You've probably heard of this before. Instead of relying on a single, centralized computer to perform a given task, this crowdsourced style of computing draws computational power from a distributed network of volunteers, typically by running special software on home PCs or smartphones. Individually, these volunteer computers aren't particularly powerful, but if you string enough of them together, their collective power can easily eclipse that of any centralized supercomputer -- and often for a fraction of the cost.

Read more
Why AI will never rule the world
image depicting AI, with neurons branching out from humanoid head

Call it the Skynet hypothesis, Artificial General Intelligence, or the advent of the Singularity -- for years, AI experts and non-experts alike have fretted (and, for a small group, celebrated) the idea that artificial intelligence may one day become smarter than humans.

According to the theory, advances in AI -- specifically of the machine learning type that's able to take on new information and rewrite its code accordingly -- will eventually catch up with the wetware of the biological brain. In this interpretation of events, every AI advance from Jeopardy-winning IBM machines to the massive AI language model GPT-3 is taking humanity one step closer to an existential threat. We're literally building our soon-to-be-sentient successors.

Read more
The best hurricane trackers for Android and iOS in 2022
Truck caught in gale force winds.

Hurricane season strikes fear into the hearts of those who live in its direct path, as well as distanced loved ones who worry for their safety. If you've ever sat up all night in a state of panic for a family member caught home alone in the middle of a destructive storm, dependent only on intermittent live TV reports for updates, a hurricane tracker app is a must-have tool. There are plenty of hurricane trackers that can help you prepare for these perilous events, monitor their progress while underway, and assist in recovery. We've gathered the best apps for following storms, predicting storm paths, and delivering on-the-ground advice for shelter and emergency services. Most are free to download and are ad-supported. Premium versions remove ads and add additional features.

You may lose power during a storm, so consider purchasing a portable power source,  just in case. We have a few handy suggestions for some of the best portable generators and power stations available. 

Read more