Groundbreaking A.I. can synthesize speech based on a person’s brain activity

Scientists from the University of California, San Francisco have demonstrated a way to use artificial intelligence to turn brain signals into spoken words. It could one day pave the way for people who cannot speak or otherwise communicate to be able to talk with those around them.

The work began with researchers studying five volunteers with severe epilepsy. These volunteers had electrodes temporarily placed on the surface of their brains in order to locate the part of the brain responsible for triggering seizures. As part of this work, the team was also able to study the way that the brain responds when a person is speaking. This included analyzing the brain signals that translate into movements of the vocal tract, which includes the jaw, larynx, lips, and tongue. An artificial neural network was then used to decode this intentionality, which was in turn used to generate understandable synthesized speech.

While still at a relatively early stage, the hope is that this work will open up some exciting possibilities. A future step will involve carrying out clinical trials to test the technology on patients who are physically unable to speak (which was not the case with this demonstration). It will also be necessary to develop an Food and Drug Administration-approved electrode device with the kind of high channel capacity (256 channels in this latest study) required to capture the necessary level of brain activity.

This isn’t the first time we’ve covered impressive brain-computer interfaces at Digital Trends. In 2017, researchers from Carnegie Mellon University developed technology that used A.I. machine learning algorithms to read complex thoughts based on brain scans, including interpreting complete sentences in some cases.

A similar project, carried out by researchers in Japan, was able to analyze fMRI brain scans and generate a written description of what that person was viewing — such as “a dog is sitting on the floor in front of an open door” or “a group of people standing on the beach.” As this technology matures, more and more examples of similarly groundbreaking work will no doubt emerge.

A paper describing UC San Francisco’s recent work, titled Speech Synthesis From Neural Decoding of Spoken Sentences, was recently published in the journal Nature.

Emerging Tech

Stallone in Terminator 2? How one deepfake prankster is changing cinema history

Ever wanted to see The Shining with Jim Carrey instead of Jack Nicholson? How about Stallone in Terminator 2: Judgement Day instead of everyone's favorite governator? Thanks to deepfakes, it's now possible -- just ask YouTuber Ctrl Shift…
Mobile

A.I. photo filters use neural networks to make photos look like Picassos

Artificial Intelligence apps put a novel spin on social network-style photo filters. Instead of just overlaying an effect, these photo filters use machine learning and neural networks to transform an image into a predetermined style.
Emerging Tech

Implant restores sight in blind patients by beaming images directly to the brain

Engineers have developed a neural implant which could help restore vision for completely blind people by bypassing non-functioning optical nerves and inputting images directly into their brains.
Emerging Tech

Elon Musk’s Neuralink wants to start operating on human brains next year

Elon Musk shed more light on his Neuralink company on Tuesday, revealing new technology for brain surgery that would allow people with paralysis to use thoughts to control smartphones and computers. But that wasn't all ...
Emerging Tech

Trippy VR demo reads your brain waves to create sleep-inducing visuals

Struggle to get to sleep? Researchers in Australia have been experimenting with ways to combine a person’s brain activity with virtual reality to create a kind of VR lullaby machine.
Emerging Tech

Elon Musk says SpaceX’s Starship can land on the moon by 2021

SpaceX boss Elon Musk said recently that he believes its Starship spacecraft can land on the moon by 2021, adding that he hopes his company can help to build a "permanently occupied lunar base" there.
Emerging Tech

Dark side of the moon: Why lunar landing conspiracies flourish online

Social media platforms seemed lovely at first, places to share dumb jokes and the minutiae of everyday life. Those sites have an underbelly, however, and have been a breeding ground for conspiracy theories.
Emerging Tech

Life after launch: Inside the massive effort to preserve NASA’s space artifacts

The Apollo 11 mission put a man on the moon, but NASA didn’t necessarily preserve every step of the process. Researchers are trying to rescue the history on Earth and on the moon.
Emerging Tech

Watch SpaceX’s parachute tests for its soon-to-be-manned Crew Dragon capsule

SpaceX is currently developing its Crew Dragon capsule to ferry astronauts to the International Space Station. Now, a new video shows the parachute systems for the capsules being tested.
Emerging Tech

A.I. cameras could help stomp out wildfires before they become disastrous

This summer marks one year since California’s deadliest and most destructive wildfire season ever. Could cutting-edge technology help avoid future incidents? One startup thinks so.
Emerging Tech

How pioneering pilot Jackie Cochran helped and hurt the Women in Space Program

Before Valentina Tereshkova became the first woman in space, Jackie Cochran funded the Women in Space Program. The pioneering woman pilot never realized her dream of venturing into space.
Emerging Tech

Prepare for liftoff! Here are all the moon missions happening in the next decade

The next 10 years are poised to be the most significant in lunar history in decades. What do we have to look forward to? Check out this handy guide to the coming decade of moon missions.
Emerging Tech

From the moon to mass production: 10 pieces of modern tech indebted to Apollo

This article is part of Apollo: A Lunar Legacy, a multi-part series that explores the technological advances behind Apollo 11, their influence on modern day, and what's next for the moon. You may have heard that freeze-dried food was…
Photography

50 years later, the first camera on the moon is still collecting lunar dust

The cameras aboard Apollo 11 captured some of history's most iconic images, including shots of Earth and footprints on the lunar surface. To commemorate the first moon landing, we look back at how Hasselblad's stripped shooters came to be.