Senior scholars and distinguished researchers are welcome to join Editorial Board of IJMERR and help organize Specil Issue on hot topics of mechanical engineering and robotics research. To propose a Special Issue, please contact us at ijmerr@ejournal.net

Instrument State Recognition and Tracking for Effective Control of Robotized Laparoscopic Systems

Manish Sahu 1, Daniil Moerman 1, Philip Mewes 1, Peter Mountney 2, and Georg Rose 3
1. Siemens AG, Healthcare Sector, Forchheim, Germany
2. Siemens Corporation, Corporate Technology, Princeton, NJ, USA
3. Otto-von-Guericke University Magdeburg
Abstract—Surgical robots are an important component for delivering advanced paradigm shifting technology such as image guided surgery and navigation. However, for robotic systems to be readily adopted into the operating room they must be easy and convenient to control and facilitate a smooth surgical workflow. In minimally invasive surgery, the laparoscope may be held by a robot but controlling and moving the laparoscope remains challenging. It is disruptive to the workflow for the surgeon to put down the tools to move the robot in particular for solo surgery approaches. This paper proposes a novel approach for naturally controlling the robot mounted laparoscope’s position by detecting a surgical grasping tool and recognizing if its state is open or close. This approach does not require markers or fiducials and uses a machine learning framework for tool and state recognition which exploits naturally occurring visual cues. Furthermore a virtual user interface on the laparoscopic image is proposed that uses the surgical tool as a pointing device to overcome common problems in depth perception. Instrument detection and state recognition are evaluated on in-vivo and ex-vivo porcine datasets. To demonstrate the practical surgical application and real time performance the system is validated in a simulated surgical environment. 

Index Terms—instrument tracking, laparoscopic surgery, machine learning, surgical robotics, visual servoing

Cite: Manish Sahu, Daniil Moerman, Philip Mewes, Peter Mountney, and Georg Rose, "Instrument State Recognition and Tracking for Effective Control of Robotized Laparoscopic Systems," International Journal of Mechanical Engineering and Robotics Research, Vol. 5, No. 1, pp. 33-38, January 2016. DOI: 10.18178/ijmerr.5.1.33-38
Copyright © 2016-2017 International Journal of Mechanical Engineering and Robotics Research, All Rights Reserved
E-mail: ijmerr@ejournal.net