A low cost and accurate guidance system for laparoscopic surgery: validation on an abdominal phantom

ABSTRACT

In this paper we present a guiding system for laparoscopic surgery which tracks in real time the laparoscopic tools and registers at 10 Hz a preoperative CT/MRI model of the patient. To help surgeons, this system provides simultaneously three kinds of supplementary information. It displays the relative positions of the laparoscopic tools and the 3D patient model. It provides two external views of the patient on which his 3D model and tool positions are superimposed. Finally, it displays an endoscopic view augmented with the 3D patient model. Contrary to most systems for laparoscopic surgery, this one is low cost (one PC, two cameras and a printer are necessary) and we have rigorously validated its tracking accuracy in simulated clinical conditions (tracking accuracy of an instrument tip close to 1.5 mm, and endoscopic overlay error under 1.0 mm). Besides, our system accuracy is comparable with commercial system's ones. Eventually, experiments on an abdominal phantom with surgeons demonstrate its usefulness. We plan to realize our first experiments on patients in a few months.

References

1. N. Ayache and O. Faugeras. Hyper: A new approach for the recognition and positioning of 2d objects. IEEE Trans. on PAMI, 8(1):44--54, January 1986.
2. F. Chassat and S. Lavallée. Experimental protocol for accuracy evaluation of 6-d localizers for computer-integrated surgery: Application to four optical localizers. In MICCAI'98, pages 277--284, 1998.
3. S. De Buck et al. A system to support laparoscopic surgery by augmented reality visualization. In MICCAI'01, pages 691--698, October 2001.
4. M. Fiala. Artag, an improved marker system based on artoolkit. NRC/ERB-1111 NRC 47166, National Research Council Canada, July 2004.
5. H. Fuchs et al. Augmented reality visualization for laparoscopic surgery. In MICCAI'98, pages 934--943, Cambridge, October 1998.
6. A. Herline, J. Stefansic, and J. e. a. Debelak. Image guided surgery: Preliminary feasibility studies of frameless stereotactic liver surgery. Archives of Surgery, 134:644--650, June 1999.
7. Hiro. Human interface technology laboratory, http://www.hitl.washington.edu/artoolkit/.
8. R. Horaud and F. Dornaika. Hand-eye calibration. Technical Report RT 99IMAG, LIFIA--IMAG--INRIA Rhône-Alpes, Grenoble, France, June 1994.
9. Daniilidis K. et al. Hand-eye calibration using dual quaternions. Int. Journal of Robotic Research, 18(3):286--298, 1999.
10. I. O. library, http://www.intel.com/research/mrl/research/opencv/.
11. J. Marescaux, F. Rubino, M. Arenas, D. Mutter, and L. Soler. Augmented-reality-assisted laparoscopic adrenalectomy. JAMA, 292(18):2214--2215, 2004.
12. G. Marti, V. Bettschart, J.-S. Billiard, and C. Baur. Hybrid method for both calibration and registration of an endoscope with an active optical tracker. In CARS, pages 159--164, 2004.
13. F. Mourgues and È. Coste-Manière. Flexible calibration of actuated stereoscopic endoscope for overlay in robot assisted surgery. In MICCAI'02, pages 25--34, 2002.
14. R. Marvik et al. Laparoscopic navigation pointer for 3-d image guided surgery. Surgical Endoscopy, June 2004.
15. S. Nicolau. Un système de réalité augmentée pour guider les opérations du foie en radiologie interventionnelle. PhD thesis, Université de Nice - Sophia Antipolis, Nov. 2004.
16. S. Nicolau, A. Garcia, X. Pennec, L. Soler, and N. Ayache. An augmented reality system to guide radio-frequency tumor ablation. In Jour. of Compute Animation and Virtual World, 16(1):1--10, 2005.
17. S. Nicolau, X. Pennec, L. Soler, and N. Ayache. Evaluation of a new 3D/2D registration criterion for liver radio-frequencies guided by augmented reality. In IS4TM'03, LNCS 2673, pages 270--283, 2003.
18. S. Nicolau, X. Pennec, L. Soler, and N. Ayache. An accuracy certified augmented reality system for therapy guidance. In European Conference on Computer Vision (ECCV'04), LNCS 3023, pages 79--91. Springer-Verlag, 2004.
19. A. Roche, X. Pennec, G. Malandain, and N. Ayache. Rigid registration of 3D ultrasound with MR images: a new approach combining intensity and gradient information. IEEE TMI, 20(10):1038--1049, Oct. 2001.
20. M. Scheuering et al. Augmented reality based on fast deformable 2D-3D registration for image-guided surgery. In Proc. SPIE Vol. 4681, p. 436--445, Medical Imaging 2002, pages 436--445.
21. M. Scheuering, A. Schneider, A. Schenk, B. Preim, and G. Greiner. Intraoperative augmented reality for minimally invasive liver interventions. In in Proc. SPIE 5029 Medical Imaging, San Diego (USA), 2003.
22. R. Shahidi et al. Implementation, calibration and accuracy testing of an image-enhanced endoscopy system. IEEE Transactions on Medical Imaging, 21(12):1524--1535, December 2002.
23. L. Soler, H. Delingette, G. Malandain, N. Ayache, and J. Marescaux. Fully automatic anatomical, pathological, and functional segmentation from CT scans for hepatic surgery. Computer Aided Surgery, 6(3), August 2001.
24. J. Traub et al. Augmented reality for port placement and navigation in robotically assisted minimally invasive cardiovascular surgery. In 8th Annual Conference of the International Society for Computer Aided Surgery (ISCAS), 2004.
25. A. D. Wiles, D. G. Thompson, and D. D. Frantz. Accuracy assessment and interpretation for optical tracking systems. In Proc. SPIE 5367, Medical Imaging 2004, pp. 421--432.
26. Z. Zhang. Flexible camera calibration by viewing a plane from unknown orientations. In Int. Conference on Computer Vision 99, pages 666--673, 1999.

Index Terms

• Applied computing

  • Life and medical sciences

    • Health care information systems

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

        • Tracking

      • Computer vision tasks

        • Scene understanding