Landmark Detection in Orbital Images Using Salience Histograms

NASA’s Jet Propulsion Laboratory, Pasadena, California

NASA’s planetary missions have collected, and continue to collect, massive volumes of orbital imagery. The volume is such that it is difficult to manually review all of the data and determine its significance. As a result, images are indexed and searchable by location and date but generally not by their content. A new automated method analyzes images and identifies “landmarks,” or visually salient features such as gullies, craters, dust devil tracks, and the like. This technique uses a statistical measure of salience derived from information theory, so it is not associated with any specific landmark type. It identifies regions that are unusual or that stand out from their surroundings, so the resulting landmarks are context-sensitive areas that can be used to recognize the same area when it is encountered again.

A machine learning classifier is used to identify the type of each discovered landmark. This classifier can also indicate when a previously unknown type of landmark is encountered, enabling the discovery of new and unusual physical phenomena. Using a specified window size, an intensity histogram is computed for each such window within the larger image (sliding the window across the image). Next, a salience map is computed that specifies, for each pixel, the salience of the window centered at that pixel. The salience map is thresholded to identify landmark contours (polygons) using the upper quartile of salience values. Descriptive attributes are extracted for each landmark polygon: size, perimeter, mean intensity, standard deviation of intensity, and shape features derived from an ellipse fit. Each landmark is classified as one of a set of known types, or marked as “unknown” using a classifier previously trained on hundreds of manually annotated landmarks. Each image is annotated with its contents (list of landmarks with their locations, types, and attributes).

This method enables fast, automated identification of landmarks to augment or replace manual analysis; fast, automated classification of landmarks to provide semantic annotations; and content-based searches over image archives.

Automated landmark detection in images permits the creation of a summary catalog of all such features in an image database, such as the Planetary Data System (PDS). It could enable entirely new searches for PDS images, based on the desired content (landmark types). In the near future, landmark identification methods using Gabor filters (texture) or covariance descriptors will also be investigated for this application.

This work was done by Kiri L. Wagstaff and Julian Panetta of Caltech; Norbert Schorghofer of the University of Hawaii; and Ronald Greeley, Mary Pendleton Hoffer, and Melissa Bunte of Arizona State University for NASA’s Jet Propulsion Laboratory. For more information, download the Technical Support Package (free white paper) at www.techbriefs.com/tsp under the Information Sciences category. NPO-46674

---

This Brief includes a Technical Support Package (TSP).

Landmark Detection In Orbital Images Using Salience Histograms

(reference NPO-46674) is currently available for download from the TSP library.

LOGIN TO DOWNLOAD

Don't have an account? Sign up here.

---