Real-Time Feature Tracking Using Homography

This software finds feature point correspondences in sequences of images. It is designed for feature matching in aerial imagery. Feature matching is a fundamental step in a number of important image processing operations: calibrating the cameras in a camera array, stabilizing images in aerial movies, geo-registration of images, and generating high-fidelity surface maps from aerial movies.

The method uses a Shi-Tomasi corner detector and normalized cross-correlation. This process is likely to result in the production of some mismatches. The feature set is cleaned up using the assumption that there is a large planar patch visible in both images. At high altitude, this assumption is often reasonable. A mathematical transformation, called an homography, is developed that allows us to predict the position in image 2 of any point on the plane in image 1. Any feature pair that is inconsistent with the homography is thrown out. The output of the process is a set of feature pairs, and the homography.

The algorithms in this innovation are well known, but the new implementation improves the process in several ways. It runs in real-time at 2 Hz on 64-megapixel imagery. The new Shi-Tomasi corner detector tries to produce the requested number of features by automatically adjusting the minimum distance between found features. The homography-finding code now uses an implementation of the RANSAC algorithm that adjusts the number of iter-
ations automatically to achieve a pre-set probability of missing a set of inliers. The new interface allows the caller to pass in a set of predetermined points in one of the images. This allows the ability to track the same set of points through multiple frames.

This work was done by Daniel S. Clouse, Yang Cheng, Adnan I. Ansar, David C. Trotz, and Curtis W. Padgett of Caltech for NASA’s Jet Propulsion Laboratory. For more information, download the Technical Support Package (free white paper) at www.techbriefs.com/tsp under the Software category.

The software used in this innovation is available for commercial licensing. Please contact Daniel Broderick of the California Institute of Technology at This email address is being protected from spambots. You need JavaScript enabled to view it.. Refer to NPO-46916.

This Brief includes a Technical Support Package (TSP).

Real-Time Feature Tracking Using Homography (reference NPO-46916) is currently available for download from the TSP library.

Please Login at the top of the page to download.


White Papers

Antenna Basics
Sponsored by rohde and schwarz a and d
3D Printing of Aerospace Parts: A Real Solution with Real Benefits
Sponsored by stratasys
Multi-Purpose Non-Contact Position/Displacement Sensing
Sponsored by Kaman
White Paper: MIL-STD-1553 IP Cores - An Emerging Technology
Sponsored by Sealevel
The Ultimate Shaft-To-Hub Connection
Sponsored by Stoffel Polygon
Overcome Challenges of Your Highly Constrained PCB Designs
Sponsored by Mentor Graphics

White Papers Sponsored By: