Motion Field and Optical Flow: Qualitative Properties

It is shown that the motion field the 2-D vector field which is the perspective projection on the image plane of the 3-D velocity field of a moving scene, and the optical flow, defined as the estimate of the motion field which can be derived from the first-order variation of the image brightness pattern, are in general different, unless special conditions are satisfied. Therefore, dense optical flow is often ill-suited for computing structure from motion and for reconstructing the 3-D velocity field by algorithms which require a locally accurate estimate of the motion field. A different use of the optical flow is suggested. It is shown that the (smoothed) optical flow and the motion field can be interpreted as vector fields tangent to flows of planar dynamical systems. Stable qualitative properties of the motion field, which give useful informations about the 3-D velocity field and the 3-D structure of the scene, usually can be obtained from the optical flow. The idea is supported by results from the theory of structural stability of dynamical systems. >

[1]  D Marr,et al.  Directional selectivity and its use in early visual processing , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[2]  H. Barlow,et al.  The mechanism of directionally selective units in rabbit's retina. , 1965, The Journal of physiology.

[3]  広 久保田,et al.  Principle of Optics , 1960 .

[4]  P. Burt,et al.  Time, distance, and feature trade-offs in visual apparent motion. , 1981 .

[5]  A. Verri,et al.  Mathematical properties of the two-dimensional motion field: from singular points to motion parameters , 1989 .

[6]  J. van Santen,et al.  Temporal covariance model of human motion perception. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[7]  Kenichi Kanatani Structure from Motion Without Correspondence: General Principle , 1985, IJCAI.

[8]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[9]  J. Gibson The perception of the visual world , 1951 .

[10]  Hans-Hellmut Nagel,et al.  An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  B K Horn,et al.  Calculating the reflectance map. , 1979, Applied optics.

[12]  M. Hirsch,et al.  Differential Equations, Dynamical Systems, and Linear Algebra , 1974 .

[13]  Alessandro Verri,et al.  Against Quantitative Optical Flow , 1987 .

[14]  A. Verri,et al.  Mathematical properties of the 2-D motion field: from singular points to motion parameters , 1989, [1989] Proceedings. Workshop on Visual Motion.

[15]  B. Hassenstein,et al.  Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus , 1956 .

[16]  Ellen C. Hildreth,et al.  Measurement of Visual Motion , 1984 .

[17]  Claude L. Fennema,et al.  Velocity determination in scenes containing several moving objects , 1979 .

[18]  E. Hildreth The computation of the velocity field , 1984, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[19]  Bui Tuong Phong Illumination for computer generated pictures , 1975, Commun. ACM.

[20]  M. Peixoto,et al.  Structural stability on two-dimensional manifolds☆ , 1962 .

[21]  Berthold K. P. Horn Robot vision , 1986, MIT electrical engineering and computer science series.

[22]  T. Poggio,et al.  A synaptic mechanism possibly underlying directional selectivity to motion , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.