A High-Speed Object Tracker from Off-the-Shelf Components

1 Background For many interesting robotics applications it is necessary to process the visual input of one or more cameras is real-time, in order to allow interaction between the robot and its environment, e.g. for visual servoing, basketball dribbling, or catching balls. Previous solutions for tracking object in cameras images either require markers on the object (e.g . Vicon setups), or they are not capable of running at high framerate of 100 Hz or more (e.g . Tyzx, OpenCV ). Fast markerless systems have been developed, but they are too expensive for most robotics research projects, because they rely on specialized hardware, such as FPGAs [1, 2, 3] or even custom-built chips [4]. To overcome these limitation, we introduce RTblob, a vision system for tracking simple colored objects that is at the same time very fast, runs on inexpensive hardware, and is available free of charge in open source form. RTblob uses a modular feed-forward architecture that makes it simple to use also for non-experts, and that allows easy adaption e.g ., to different camera setups and tracking tasks.

[1]  Shinichi Hirai,et al.  CMOS+FPGA vision system for visual feedback of mechanical systems , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[2]  Masatoshi Ishikawa,et al.  1 ms column parallel vision system and its application of high speed target tracking , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[3]  Bernd Jähne,et al.  Digital Image Processing: Concepts, Algorithms, and Scientific Applications , 1991 .

[4]  J. P. Lewis,et al.  Fast Template Matching , 2009 .

[5]  Qi Tian,et al.  Algorithms for subpixel registration , 1986 .

[6]  Masatoshi Ishikawa,et al.  955-fps Real-time Shape Measurement of a Moving/Deforming Object using High-speed Vision for Numerous-point Analysis , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[7]  Ulrich Muehlmann,et al.  A new high speed cmos camera for real-time tracking applications , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[8]  Marc Pollefeys,et al.  Multiple view geometry , 2005 .

[9]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.