A Feature Map Approach to Real-Time 3-D Object Pose Estimation from Single 2-D Perspective Views

A novel approach to the computation of an approximate estimate of spatial object pose from camera images is proposed. The method is based on a neural network that generates pose hypotheses in real time, which can be refined by registration or tracking systems. A modification of Kohonen's self-organizing feature map is systematically trained with computer generated object views such that it responds to a preprocessed image with one or more sets of object orienta­ tion parameters. The key concepts proposed are representations of spatial orienta­ tion that result in continuous distance measures, and the choice of a fixed network topology that is best suited to the representation of 3-D orientation. Experimen­ tal results from both simulated and real images demonstrate that a pose estimate within the accuracy requirements can be found in more than 90% of all cases. The current implementation operates at near frame rate on real world images.

[1]  Gerd Hirzinger,et al.  Real-time pose estimation of 3D objects from camera images using neural networks , 1997, Proceedings of International Conference on Robotics and Automation.

[2]  Hon-Son Don,et al.  A neural network approach to 3D object identification and pose estimation , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[3]  Helge Ritter,et al.  Learning with the Self-Organizing Map , 1991 .

[4]  Gerd Hirzinger,et al.  Registration of CAD-models to images by iterative inverse perspective matching , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[5]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[6]  David G. Lowe,et al.  Fitting Parameterized Three-Dimensional Models to Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Kang Park,et al.  Recognition and localization of a 3D polyhedral object using a neural network , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[8]  Ken Shoemake,et al.  Animating rotation with quaternion curves , 1985, SIGGRAPH.