Suggested Searches

3 min read

AI-Spy with My Little Eye

image of a volcano and mountainous region on Earth
This photo taken from the International Space Station helped identify distinct land features on Tenerife Island in Spain’s Canary Islands. Artificial intelligence has assessed images like this to identify lava flows and volcano types in photographs captured worldwide.
Credits: NASA

Spotting Topographic Changes from 250 Miles Above

Crew members aboard the International Space Station collect imagery during studies like Crew Earth Observations and Hurricane-Visual, pointing cameras at interesting features on our planet. Once a picture is taken, it often needs further processing to enhance its scientific usefulness. Historically, this step has been a manual task, but now researchers are assigning it to artificial intelligence (AI).

The Earth Science and Remote Sensing Unit at NASA’s Johnson Space Center in Houston, Texas, is using machine learning to sort through and identify photos taken from the orbital laboratory, making them more searchable and useful to scientists. The Gateway to Astronaut Photography of Earth service contains nearly 4 million astronaut-captured images. Using AI, researchers have categorized over 2 million photos of Earth’s geographic features, 250,000 images of auroras, 37,000 lightning photos, and 18,000 images of 64 different cities around the world.

While the technology to capture imagery of Earth from satellites has existed since the 1960s, use of AI in image processing is a recent development. After training the AI model on satellite imagery of Earth, NASA scientists began using it to process significant quantities of imagery at a rate far faster than any human cataloger.

image of lakes in a desert
image of a lake in a desert
Mosaics created from astronaut imagery of the Toshka Lakes in Egypt. The top image, taken in 2002, and the bottom image, taken in 2015, show how these bodies of water have changed over time.
Credits: NASA

“Crew Earth Observations serves as a longitudinal record of what the Earth looks like at specific times,” said data scientist Alex Stoken, who works on the team responsible for managing the operation. “For example, NASA has a 20-year photographic record of the Toshka Lakes in Egypt that can be studied to understand the changes to water levels in the lakes. With AI, we can identify more of these change areas and study them in greater detail.”

Scientists also request images of Earth sites that have comparable features to structures on other planets, such as impact craters. For example, Tenerife Island, the largest of the Canary Islands, has formations over 30 million years old that are reminiscent of features found on other planetary surfaces.

“When we use machine learning to identify mountainous photos or photos with large boulders, we are also searching for potential sites that are analogous to places on the Moon and Mars,” said Stoken. “If we can better understand how those processes happened on Earth, maybe it will teach us something about other potential future space destinations.”

Analyzing modern astronaut imagery helps researchers to better understand Earth and its changing landscapes and to refine and validate algorithms to support future exploration missions and aid planetary scientists in studying our solar system.