Skip to main content

You can help teach NASA rovers to explore Mars with the AI4Mars project

Artificial intelligence could be a huge help to Mars rovers like NASA’s Curiosity or Perseverance, but first these A.I. systems need to be trained on what to look for. A NASA project invites members of the public to help identify features of the Martian landscape, in order to train an algorithm that future rovers could use to navigate around the red planet.

The robotic arm of NASA’s Perseverance rover is visible in this image used by the AI4Mars project.
The robotic arm of NASA’s Perseverance rover is visible in this image used by the AI4Mars project. Users outline and identify different rock and landscape features to help train an artificial intelligence algorithm that will help improve the capabilities of Mars rovers. NASA/JPL-Caltech

The AI4Mars project was launched last year, and users have already labeled nearly half a million images to help develop the Soil Property and Object Classification (SPOC) algorithm. This algorithm identifies features of the landscape like sand and rock, and does so correctly nearly 98% of the time. In the future, this algorithm could be incorporated into Mars rovers’ autonomous driving capabilities like the AutoNav technology used by Perseverance.

Now, the researchers want to expand SPOC to get more detailed information about rock formations such as the presence of float rocks or nodules. By automatically classifying the types of rock imaged by rovers, the researchers can send driving instructions back to the rovers more quickly.

“It’s not possible for any one scientist to look at all the downlinked images with scrutiny in such a short amount of time, every single day,” explained Vivian Sun, a JPL scientist who helps coordinate Perseverance’s daily operations and consulted on the AI4Mars project. “It would save us time if there was an algorithm that could say, ‘I think I saw rock veins or nodules over here,’ and then the science team can look at those areas with more detail.”

To help develop this algorithm, NASA is inviting members of the public to go to the AI4Mars page on Zooniverse and look at images of the Martian surface captured by the Curiosity rover. They are asked to draw polygons around particular features like sand, soil, bedrock, and large rocks. The results of thousands of classifications made by the public are then collated and checked by scientists to make sure that the labeling is accurate.

Over time, as more individual pieces of data are labeled, the algorithm can learn to distinguish features for itself.

“Machine learning is very different from normal software,” said lead researcher for the AI4Mars project, Hiro Ono. “This isn’t like making something from scratch. Think of it as starting with a new brain. More of the effort here is getting a good dataset to teach that brain and massaging the data so it will be better learned.”

Editors' Recommendations

Georgina Torbet
Georgina is the Digital Trends space writer, covering human space exploration, planetary science, and cosmology. She…
NASA video celebrates Mars helicopter following its final flight
NASA’s Ingenuity Mars helicopter is seen here in a close-up taken by Mastcam-Z, a pair of zoomable cameras aboard the Perseverance rover. This image was taken on April 5, the 45th Martian day, or sol, of the mission.

Legacy of NASA’s Ingenuity Mars Helicopter

NASA’s record-setting Mars helicopter, Ingenuity, has taken its final flight, the space agency confirmed on Thursday.

Read more
NASA regains communications with Mars helicopter Ingenuity
The Ingenuity helicopter is pictured on the surface of Mars.

Just a few days after losing contact with the Mars helicopter Ingenuity, NASA announced that it has regained communications with the plucky little helicopter. In a post on X (formerly Twitter), NASA's Jet Propulsion Laboratory, which designed and operated the helicopter, announced that it is back in touch following an unexpected communications dropout.

The Ingenuity helicopter is pictured on the surface of Mars. NASA

Read more
Scientists want your help to search for black holes
An illustration of a black hole.

Even though black holes swallow anything that comes near them -- even light -- they are still possible to locate by looking for signs of their effects. Black holes are extremely dense, so they have a lot of mass and a strong gravitational effect that can be observed from light-years away. But the universe is a big place, and researchers are hoping that the public can help them to identify more black holes in the name of scientific exploration.

A project called Black Hole Hunter invites members of the public to search through data collected by NASA's Transiting Exoplanet Survey Satellite (TESS) to look for signs of a black hole. Using a technique called gravitational microlensing, citizen scientists will look at how the brightness of light from various stars changes over time, looking for indications that a black hole could have passed in front of a star and bent the light coming from it. This should enable the project to identify black holes that would otherwise be invisible.

Read more