Seeing Behind Occlusions

The location of objects in images is difficult owing to the view variance of geometric features but can be determined by developing viewinsensitive descriptions of the intensities local to image points. Viewinsensitive descriptions are achieved in this work by describing points in terms of the responses of steerable filters at multiple scales. Owing to the use of multiple scales, the vector for each point is, for all practical purposes, unique, and thus can be easily matched to other instances of the point in other images. We show that this method can be extended to handle the case where the area near a point of interest is partially occluded. The method uses a description of the occluder in the form of a template that can be obtained easily via active vision systems using a method such as disparity filtering.

[1]  John K. Tsotsos,et al.  Active object recognition , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  S. Nayar,et al.  Learning and Recognition of 3-D Objects from Brightness Images * , 1993 .

[4]  Dana H. Ballard,et al.  Behavioural constraints on animate vision , 1989, Image Vis. Comput..

[5]  Christoph von der Malsburg,et al.  A Neural System for the Recognition of Partially Occluded Objects in Cluttered Scenes: A Pilot Study , 1993, Int. J. Pattern Recognit. Artif. Intell..

[6]  Jitendra Malik,et al.  A Computational Framework for Determining Stereo Correspondence from a Set of Linear Spatial Filters , 1991, ECCV.

[7]  Werner Frei,et al.  Fast Boundary Detection: A Generalization and a New Algorithm , 1977, IEEE Transactions on Computers.

[8]  D. Ballard,et al.  Object recognition using steerable filters at multiple scales , 1993, [1993] Proceedings IEEE Workshop on Qualitative Vision.

[9]  K Nakayama,et al.  Toward a neural understanding of visual surface representation. , 1990, Cold Spring Harbor symposia on quantitative biology.

[10]  Dana H. Ballard,et al.  Animate Vision , 1991, Artif. Intell..

[11]  Jitendra Malik,et al.  Computational framework for determining stereo correspondence from a set of linear spatial filters , 1992, Image Vis. Comput..

[12]  Jitendra Malik,et al.  A computational model of texture segmentation , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Olle Seger,et al.  Rotation Invariance in Gradient and Higher Order Derivative Detectors , 1990, Computer Vision Graphics and Image Processing.

[14]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[15]  Allan D. Jepson,et al.  Simple method for computing 3D motion and depth , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[16]  David Coombs,et al.  Localized Binocular Attention and Real-time Smooth Pursuit in Moving Robots , 1992, AAAI 1992.