Point Matching Under Large Image Deformations and Illumination Changes

Bogdan Georgescu(1) and Peter Meer(1,2)

(1)Department of Computer Science
(2)Department of Electrical and Computer Engineering
Rutgers University, Piscataway, NJ 08854, USA

To solve the general point correspondence problem in which the underlying transformation between image patches is represented by a homography, a solution based on extensive use of first order differential techniques is proposed. We integrate in a single robust M-estimation framework the traditional optical flow method and matching of local color distributions. These distributions are computed with spatially oriented kernels in the 5D joint spatial/color space. The estimation process is initiated at the third level of a Gaussian pyramid, uses only local information, and the illumination changes between the two images are also taken into account. Subpixel matching accuracy is achieved under large projective distortions significantly exceeding the performance of any of the two components alone. As an application the correspondence algorithm is employed in oriented tracking of objects.

IEEE Trans. Pattern Anal. Machine Intell, 26, 674-689, 2004.
Return to Research: Robust Analysis of Visual Data        Return to List of Publications
Download the paper