A System for Robotic Heart Surgery that Learns to Tie Knots Using Recurrent Neural Networks

Tying suture knots is a time-consuming task performed frequently during minimally invasive surgery (MIS). Automating this task could greatly reduce total surgery time for patients. Current solutions to this problem replay manually programmed trajectories, but a more general and robust approach is to use supervised machine learning to smooth surgeon-given training trajectories and generalize from them. Since knottying generally requires a controller with internal memory to distinguish between identical inputs that require different actions at different points along a trajectory, it would be impossible to teach the system using traditional feedforward neural nets or support vector machines. Instead we exploit more powerful, recurrent neural networks (RNNs) with adaptive internal states. Results obtained using LSTM RNNs trained by the recent Evolino algorithm show that this approach can significantly increase the efficiency of suture knot tying in MIS over preprogrammed control

[1]  Eduardo Sontag,et al.  Turing computability with neural nets , 1991 .

[2]  Risto Miikkulainen,et al.  Efficient Reinforcement Learning through Symbiotic Evolution , 1996, Machine Learning.

[3]  A. García-Ruiz,et al.  Robotic surgical instruments for dexterity enhancement in thoracoscopic coronary artery bypass graft. , 1997, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[4]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[5]  A. García-Ruiz,et al.  Manual vs robotically assisted laparoscopic surgery in the performance of basic manipulation and suturing tasks. , 1998, Archives of surgery.

[6]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[7]  Risto Miikkulainen,et al.  Solving Non-Markovian Control Tasks with Neuro-Evolution , 1999, IJCAI.

[8]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[9]  G. S. Guthart,et al.  The Intuitive Telesurgery System , 2000 .

[10]  John Kenneth Salisbury,et al.  The Intuitive/sup TM/ telesurgery system: overview and application , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[11]  Yoshua Bengio,et al.  Gradient Flow in Recurrent Nets: the Difficulty of Learning Long-Term Dependencies , 2001 .

[12]  Jürgen Schmidhuber,et al.  LSTM recurrent networks learn simple context-free and context-sensitive languages , 2001, IEEE Trans. Neural Networks.

[13]  Hyosig Kang,et al.  ROBOTIC ASSISTED SUTURING IN MINIMALLY INVASIVE SURGERY , 2002 .

[14]  Risto Miikkulainen,et al.  Active Guidance for a Finless Rocket Using Neuroevolution , 2003, GECCO.

[15]  Alois Knoll,et al.  Endo[PA]R: An Open Evaluation System for Minimally Invasive Robotic Surgery , 2004 .

[16]  Alois Knoll,et al.  The Endo[PA]R system for minimally invasive robotic surgery , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[17]  Jürgen Schmidhuber,et al.  Evolino: Hybrid Neuroevolution/Optimal Linear Search for Sequence Learning , 2005, IJCAI.