Parametric Shape-from-Shading by Radial Basis Functions

We present a new method of shape from shading by using radial basis functions to parameterize the object depth. The radial basis functions are deformed by adjusting their centers, widths, and weights such that the intensity errors are minimized. The initial centers and widths are arranged hierarchically to speed up convergence and to stabilize the solution. Although the smoothness constraint is used, it can be eventually dropped out without causing instabilities in the solution. An important feature of our parametric shape-from-shading method is that it offers a unified framework for integration of multiple sensory information. We show that knowledge about surface depth and/or surface normals anywhere in the image can be easily incorporated into the shape from shading process. It is further demonstrated that even qualitative knowledge can be used in shape from shading to improve 3D reconstruction. Experimental comparisons of our method with several existing ones are made by using both synthetic and real images. Results show that our solution is more accurate than the others.

[1]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[2]  Aaron F. Bobick,et al.  The direct computation of height from shading , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Mubarak Shah,et al.  Analysis of shape from shading techniques , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Berthold K. P. Horn.  Height and gradient from shading , 1989, International Journal of Computer Vision.

[5]  Terrance E. Boult,et al.  Constraining Object Features Using a Polarization Reflectance Model , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Kuo-Chin Fan,et al.  Wavelet-Based Shape from Shading , 1995, CVGIP Graph. Model. Image Process..

[7]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[8]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  William H. Press,et al.  Numerical Recipes in FORTRAN - The Art of Scientific Computing, 2nd Edition , 1987 .

[10]  Paul Dupuis,et al.  Direct method for reconstructing shape from shading , 1991, Optics & Photonics.

[11]  Rama Chellappa,et al.  Reconstructing a 3-D depth map from one or more images , 1991, CVGIP Image Underst..

[12]  M. J. D. Powell,et al.  Radial basis functions for multivariable interpolation: a review , 1987 .

[13]  Michael J. Brooks,et al.  Shape and Source from Shading , 1985, IJCAI.

[14]  M.D. Levine,et al.  Where and Why Local Shading Analysis Works , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[16]  Dr. M. G. Worster.  Methods of Mathematical Physics , 1947, Nature.

[17]  Azriel Rosenfeld,et al.  Improved Methods of Estimating Shape from Shading Using the Light Source Coordinate System , 1985, Artif. Intell..

[18]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[19]  Michael J. Brooks,et al.  The variational approach to shape from shading , 1986, Comput. Vis. Graph. Image Process..

[20]  Takeo Kanade,et al.  Shape from interreflections , 2004, International Journal of Computer Vision.

[21]  Demetri Terzopoulos,et al.  Regularization of Inverse Visual Problems Involving Discontinuities , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Alfred M. Bruckstein,et al.  Tracking Level Sets by Level Sets: A Method for Solving the Shape from Shading Problem , 1995, Comput. Vis. Image Underst..

[23]  C.-C. Jay Kuo,et al.  Surface reconstruction from photometric stereo images , 1993 .

[24]  Richard Szeliski,et al.  Fast shape from shading , 1990, CVGIP Image Underst..

[25]  Demetri Terzopoulos,et al.  Image Analysis Using Multigrid Relaxation Methods , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Gerd Hirzinger,et al.  Learning shape from shading by a multilayer network , 1996, IEEE Trans. Neural Networks.

[27]  Christopher J. Taylor,et al.  Robust shape from shading , 1994, Image Vis. Comput..

[28]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[29]  Alex Pentland,et al.  Local Shading Analysis , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Stan Z. Li,et al.  On Discontinuity-Adaptive Smoothness Priors in Computer Vision , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[32]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[33]  C.-C. Jay Kuo,et al.  Shape from Shading with a Linear Triangular Element Surface Model , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  A. Ardeshir Goshtasby,et al.  Curve Fitting by a Sum of Gaussians , 1994, CVGIP Graph. Model. Image Process..

[35]  Kyoung Mu Lee,et al.  Shape from Shading with Perspective Projection , 1994 .

[36]  Berthold K. P. Horn.  Obtaining shape from shading information , 1989 .

[37]  Rama Chellappa,et al.  Estimation of illuminant direction, albedo, and shape from shading , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[38]  John Oliensis,et al.  Uniqueness in shape from shading , 1991, International Journal of Computer Vision.

[39]  Katsushi Ikeuchi,et al.  Numerical Shape from Shading and Occluding Boundaries , 1981, Artif. Intell..