What can two images tell us about a third one?

This paper discusses the problem of predicting image features in an image from image features in two other images and the epipolar geometry between the three images. We adopt the most general camera model of perpective projection and show that a point can be predicted in the third image as a bilinear function of its images in the first two cameras, that the tangents to three corresponding curves are related by a trilinear function, and that the curvature of a curve in the third image is a linear function of the curvatures at the corresponding points in the other two images. We thus answer completely the following question: given two views of an object, what would a third view look like? We show that in the special case of orthographic projection our results for points reduce to those of Ullman and Basri [19]. We demonstrate on synthetic as well as on real data the applicability of our theory.

[1]  J. G. Semple,et al.  Algebraic Projective Geometry , 1953 .

[2]  Akira Ishii,et al.  Three-View Stereo Analysis , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  O. Silven,et al.  Progress in trinocular stereo , 1988 .

[4]  Yoshifumi Kitamura,et al.  Three-dimensional data acquisition by trinocular vision , 1989, Adv. Robotics.

[5]  Luce Morin,et al.  Relative Positioning with Poorly Calibrated Cameras , 1990 .

[6]  Kenichi Kanatani,et al.  Computational projective geometry , 1991, CVGIP Image Underst..

[7]  Olivier D. Faugeras,et al.  Curve-based stereo: figural continuity and curvature , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  R. Basri.  On the Uniqueness of Correspondence under Orthographic and Perspective Projections , 1991 .

[9]  Roger Mohr,et al.  It can be done without camera calibration , 1991, Pattern Recognit. Lett..

[10]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[12]  Rajiv Gupta,et al.  Stereo from uncalibrated cameras , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  O. D. Faugeras,et al.  Camera Self-Calibration: Theory and Experiments , 1992, ECCV.

[14]  John Illingworth,et al.  Line Based Trinocular Stereo , 1992, BMVC.

[15]  Eamon B. Barrett,et al.  Some invariant linear methods in photogrammetry and model-matching , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  R. Basri.  On the Uniqueness of Correspondence from Orthographic and Perspective Projection , 1992 .

[17]  L. Robert.  Perception stereoscopique de courbes et de surfaces tridimensionnelles. Application a la robotique mobile , 1993 .

[18]  O. Faugeras,et al.  On determining the fundamental matrix : analysis of different methods and experimental results , 1993 .

[19]  Amnon Shashua,et al.  Projective depth: A geometric invariant for 3D reconstruction from two perspective/orthographic views and for visual recognition , 1993, 1993 (4th) International Conference on Computer Vision.

[20]  Amnon Shashua,et al.  On Geomatric and Algebraic Aspects of 3D Affine and Projective Structures from Perspective 2D Views , 1993, Applications of Invariance in Computer Vision.

[21]  Emanuele Trucco,et al.  Geometric Invariance in Computer Vision , 1995 .

[22]  S. P. Mudur,et al.  Three-Dimensional Computer Vision: A Geometric Viewpoint , 1995 .