Skip to main content

Face-scanning A.I. can help doctors spot unusual genetic disorders

Facial recognition can help unlock your phone. Could it also be able to play a far more valuable role in people’s lives by identifying whether or not a person has a rare genetic disorder, based exclusively on their facial features? DeepGestalt, an artificial intelligence built by the Boston-based tech company FDNA, suggests that the answer is a resounding “yes.”

The algorithm is already being used by leading geneticists at more than 2,000 sites in upward of 130 countries around the world. In a new study, published in the journal Nature Medicine, researchers show how the algorithm was able to outperform clinicians when it came to identifying diseases.

The study involved 17,000 kids with 200-plus genetic disorders. Its best performance came in distinguishing between different subtypes of a genetic disorder called Noonan syndrome, one of whose symptoms includes mildly unusual facial features. The A.I. was able to make the correct distinction 64 percent of the time. That is far from perfect, but it is significantly better than human clinicians, who identified Noonan syndrome correctly in just 20 percent of cases.

“DeepGestalt is a facial image analysis framework that is able to highlight similarities to hundreds of genetic disorders,” Yaron Gurovich, chief technology officer at FDNA, told Digital Trends. “It is a type of artificial intelligence that is able to efficiently learn the relevant visual appearances of genetic conditions, and provide relevancy scores for [them]. It is based on the recent machine learning tools, called deep learning. In practice, we use artificial neural networks to learn subtle patterns in the face and create a mathematical representation for those. DeepGestalt is like a mathematical aggregated representation of the knowledge of thousands [of] experts.”

To create their system, the researchers first taught it to identify faces using a general facial data set available on the web. They then used a technique called “transfer learning” to teach the machine to be able to stop genetic disorders. “This step is similar to teaching a human [a] new subject,” Gurovich continued. “Once you know the basics — [how to] analyze faces — it is much easier to learn special cases, [such as analyzing] genetic disorders.”

As noted, FDNA’s A.I. is already being used by clinicians in the form of a community platform called Face2Gene. This tool lets medics with permission from their patients upload images to the platform. Face2Gene is then able to help narrow down possible disease so that doctors can explore them further. An estimated 70 percent of clinical geneticists are reportedly using the tool.

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
No more panels? A.I. helps create sprayable solar cells that can be painted on
Aerial Solar Image

Solar power is enormously promising when it comes to providing a source of sustainable energy. But solar panels take up a lot of space, which can limit their appeal and practicality. Enormous solar farms stretching as far as the eye can see might be an option in rural locations where space is readily available. However, go into a city and the number of places you might be able to deploy photovoltaics drastically decreases. Unless robots have anything to say about it, that is.

At the University of Central Florida, researchers have been using machine learning to optimize the materials used to make special solar cells. Their goal? To develop the insights that will make spray-on solar cells, which are applicable just about antwhere, a reality. Such sprayable cells could be used to paint anything from bridges to skyscrapers. It would then capture light and turn it into energy for the electrical grid.

Read more
New cardiology A.I. knows if you’ll die soon. Doctors can’t explain how it works
cardiology ai predicts death toe tag

Here’s a scenario scary enough to warrant a horror movie: An artificial intelligence that is able to accurately predict your chances of dying in the next year by looking at heart test results, despite the fact that the results may look totally fine to trained doctors. The good news: The technology might just wind up saving your life one day.

“We have developed two different artificial intelligence algorithms that can automatically analyze electrical tracings from the heart and make predictions about the likelihood of a future important clinical event,” Brandon Fornwalt, from Pennsylvania-based healthcare provider Geisinger, told Digital Trends.

Read more
This A.I.-powered app can spot skin cancer with 95 percent accuracy
skinvision app detects cancer 95 percent  38

Detect skin cancer with your phone using SkinVision

If you’re going to trust your smartphone to do something as important as detect the most common forms of skin cancer, you want to be pretty darn sure that it works as advertised. Fortunately, the claims of an app called SkinVision appear to be accurate.

Read more