Compensating beating heart motion displayed by a heart motion simulator

The compensation of motion of the beating heart is investigated in the context of minimally invasive robotic surgery. Although reduced by mechanical stabilisers, residual tissue motion makes surgery still difficult and time consuming. Compensation for this motion is therefore highly desirable. Motion can be captured by tracking natural landmarks on the heart surface viewed by a video endoscope. The proposed motion compensation scenario uses tracked motion information on the beating heart to stabilise image motion at the surgeon's display and to move his instruments accordingly, i.e. synchronously to the surface of the beating heart. The setup uses a specially designed heart motion simulator to display real heart motion and employs a particular prediction strategy to overcome latencies, which is required to achieve synchronous motion of robot instruments and the heart surface. Results show that the proposed methods are suitable to achieve the desired compensation of heart motion.

[1]  Bernhard Kübler,et al.  Development of actuated and sensor integrated forceps for minimally invasive robotic surgery , 2006 .

[2]  V. Falk Manual control and tracking--a human factor analysis relevant for beating heart surgery. , 2002, Annals of Thoracic Surgery.

[3]  Bernhard Kübler,et al.  Selection of Qualified Colour Markers for Heart Surface Tracking , 2004 .

[4]  R. E. Stamper,et al.  A Three Degree of Freedom Parallel Manipulator with Only Translational Degrees of Freedom , 1997 .

[5]  Tobias Ortmaier,et al.  Motion estimation in beating heart surgery , 2005, IEEE Transactions on Biomedical Engineering.

[6]  G Hirzinger,et al.  Development of actuated and sensor integrated forceps for minimally invasive robotic surger , 2005, The international journal of medical robotics + computer assisted surgery : MRCAS.

[7]  L. W. Tsai,et al.  Robot Analysis: The Mechanics of Serial and Parallel Ma-nipulators , 1999 .

[8]  Yoshihiko Nakamura,et al.  Heartbeat synchronization for robotic cardiac surgery , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[9]  Gerd Hirzinger,et al.  Image stabilisation of the beating heart by local linear interpolation , 2006, SPIE Medical Imaging.

[10]  Alin Albu-Schäffer,et al.  DLR's torque-controlled light weight robot III-are we reaching the technological limits now? , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[11]  Philippe Martinet,et al.  A Review on the Dynamic Control of Parallel Kinematic Machines: Theory and Experiments , 2009, Int. J. Robotics Res..

[12]  M Calderón Training model for "beating-heart" coronary artery anastomoses. , 1999, The Annals of thoracic surgery.

[13]  Volkmar Falk,et al.  Limitations for manual and telemanipulator-assisted motion tracking--implications for endoscopic beating-heart surgery. , 2003, The Annals of thoracic surgery.

[14]  Gerd Hirzinger,et al.  Structure driven substitution of specular reflections for realtime heart surface tracking , 2005, IEEE International Conference on Image Processing 2005.

[15]  F. Takens Detecting strange attractors in turbulence , 1981 .

[16]  Tobias Ortmaier,et al.  Tracking local motion on the beating heart , 2002, SPIE Medical Imaging.

[17]  Robert Haslinger,et al.  MICA - A new generation of versatile instruments in robotic surgery , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Luc Soler,et al.  Beating heart tracking in robotic surgery using 500 Hz visual servoing, model predictive control and an adaptive observer , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[19]  A. Yim,et al.  Training model for "beating-heart" coronary artery anastomoses. , 1998, The Annals of thoracic surgery.

[20]  Gerd Hirzinger,et al.  OPTICAL FLOW TO ANALYSE STABILISED IMAGES OF THE BEATING HEART , 2006 .

[21]  Alin Albu-Schäffer,et al.  DLR MiroSurge: a versatile system for research in endoscopic telesurgery , 2010, International Journal of Computer Assisted Radiology and Surgery.