A Camera-Based Mobility Aid for Visually Impaired People

We present a wearable assistance system for visually impaired persons that perceives the environment with a stereo camera system and communicates obstacles and other objects to the user in form of intuitive acoustic feedback. The system is designed to complement traditional assistance aids. We describe the core techniques of scene understanding, head tracking, and sonification and show in an experimental study that it enables users to walk in unknown urban terrain and to avoid obstacles safely.

[1]  E. Kraft,et al.  A quaternion-based unscented Kalman filter for orientation tracking , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[2]  Martin Lauer,et al.  Robust ground plane tracking in cluttered environments from egocentric stereo vision , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Stergios I. Roumeliotis,et al.  Stochastic cloning: a generalized framework for processing relative state measurements , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[4]  J. Blauert.  Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[5]  Gérard G. Medioni,et al.  Robot vision for the visually impaired , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[6]  Yiannos Manoli,et al.  Stochastic cloning Kalman filter for visual odometry and inertial/magnetic data fusion , 2013, Proceedings of the 16th International Conference on Information Fusion.

[7]  Nikolaos G. Bourbakis,et al.  Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  L. Kay.  An ultrasonic sensing probe as a mobility aid for the blind , 1964 .

[9]  José Braz,et al.  Informatics in Control, Automation and Robotics I , 2006 .

[10]  Shraga Shoval,et al.  NavBelt and the guideCane , 2003 .

[11]  Martin Lauer,et al.  Geometry Estimation of Urban Street Canyons Using Stereo Vision from Egocentric View , 2015 .

[12]  J.L. Gonzalez-Mora,et al.  Seeing the world by hearing: Virtual Acoustic Space (VAS) a new space perception system for blind people. , 2006, 2006 2nd International Conference on Information & Communication Technologies.

[13]  Shraga Shoval,et al.  NavBelt and the Guide-Cane [obstacle-avoidance systems for the blind and visually impaired] , 2003, IEEE Robotics Autom. Mag..

[14]  Julius Ziegler,et al.  StereoScan: Dense 3d reconstruction in real-time , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[15]  Davide Rocchesso,et al.  The Sonification Handbook , 2011 .