Toward real-time image guided neurosurgery using distributed and grid computing

ABSTRACT

Neurosurgical resection is a therapeutic intervention in the treatment of brain tumors. Precision of the resection can be improved by utilizing Magnetic Resonance Imaging (MRI) as an aid in decision making during Image Guided Neurosurgery (IGNS). Image registration adjusts pre-operative data according to intra-operative tissue deformation. Some of the approaches increase the registration accuracy by tracking image landmarks through the whole brain volume. High computational cost used to render these techniques inappropriate for clinical applications.In this paper we present a parallel implementation of a state of the art registration method, and a number of needed incremental improvements. Overall, we reduced the response time for registration of an average dataset from about an hour and for some cases more than an hour to less than seven minutes, which is within the time constraints imposed by neurosurgeons. For the first time in clinical practice we demonstrated, that with the help of distributed computing non-rigid MRI registration based on volume tracking can be computed intra-operatively.

REFERENCES

• 1: Abou-Rjeili, A., and Karypis, G. 2006. Multilevel algorithms for partitioning power-law graphs. In IEEE International Parallel and Distributed Processing Symposiu.
• 2: American Cancer Society, 2005. Cancer facts and figures: 2005. http://www.cancer.org/docroot/STT/stt_0_2005.asp?sitearea=STT\&level=1, accessed 16 Feb 2006.
• 3: Apache Software Foundation, 2006. Apache axis project. http://ws.apache.org/axis/, accessed 23 April 2006.
• 4: Archip, N., Fedorov, A., Lloyd, B., Chrisochoides, N., Golby, A., Black, P. M., and Warfield, S. K. 2006. Integration of patient specific modeling and advanced image processing techniques for image guided neurosurgery. In Proceedings of SPIE 6141 Medical Imaging 2006: Visualization, Image-Guided Procedures, and Display, K. Cleary and R. G. Jr., Eds., vol. 61411E.
• 5: Argonne National Laboratory, 2005. PETSc: Portable, extensible toolkit for scientific computation. v.2.3.0, http://www-unix.mcs.anl.gov/petsc/petsc-2/, Accessed 16 Feb, 2006.
• 6: Kevin Barker , Andrey N. Chernikov , Nikos Chrisochoides , Keshav Pingali, A Load Balancing Framework for Adaptive and Asynchronous Applications, IEEE Transactions on Parallel and Distributed Systems, v.15 n.2, p.183-192, February 2004 [doi>10.1109/TPDS.2004.1264800]
• 7: Basermann, A., Clinckemaillie, J., Coupez, T., Fingberg, J., Digonnet, H., Ducloux, R., Gratien, J., Hartmann, U., Lonsdale, G., Maerten, B., Roose, D., and Walshaw, C. 2000. Dynamic load-balancing of finite element applications with the drama library. Applied Mathematical Modeling 25, 83--98.
• 8: Belguelin, A., Dongarra, J., Geist, A., Manchek, R., Otto, S., and Walpore, J. 1993. Pvm: Experiences, current status, and future direction. In Supercomputing '93 Proceedings, 765--766.
• 9: Bierling, M. 1988. Displacement estimation by hierarchical block matching. In Proceedings of SPIE Visual Communication and Image Processing, vol. 1001, 942--951.
• 10: Black, P. 1998. Management of malignant glioma: role of surgery in relation to multimodality therapy. Journal of Neurovirology 4, 2, 227--236.
• 11: Robert D. Blumofe , Christopher F. Joerg , Bradley C. Kuszmaul , Charles E. Leiserson , Keith H. Randall , Yuli Zhou, Cilk: an efficient multithreaded runtime system, Proceedings of the fifth ACM SIGPLAN symposium on Principles and practice of parallel programming, p.207-216, July 19-21, 1995, Santa Barbara, California, United States
• 12: Chakravorty, S., and Kalé, L. 2004. A fault tolerant protocol for massively parallel systems. In Proceedings of the 18th International Parallel and Distributed Processing Symposium.
• 13: Chrisochoides, N. 2005. Numerical Solution of Partial Differential Equations on Parallel Computers. No. 51 in Lecture Notes in Computational Science and Enginering. Springer-Verlag, December, ch. Parallel Mesh Generation, 237--264.
• 14: Clatz, O., Delingette, H., Talos, I. F., Golby, A. J., Kikinis, R., Jolesz, F. A., Ayache, N., and Warfield, S. K. 2005. Robust non-rigid registration to capture brain shift from intra-operative MRI. IEEE Transactions on Medical Imaging 24, 11, 1417--1427.
• 15: College of William&Mary, 2006. SciClone Cluster Project. http://www.compsci.wm.edu/SciClone/, accessed 23 April 2006.
• 16: Thomas Decker, virtual data space—load balancing for irregular applications, Parallel Computing, v.26 n.13-14, p.1825-1860, Dec., 2000 [doi>10.1016/S0167-8191(00)00061-2 ]
• 17: Karen Devine , Bruce Hendrickson , Erik Boman , Matthew St. John , Courtenay Vaughan, Design of dynamic load-balancing tools for parallel applications, Proceedings of the 14th international conference on Supercomputing, p.110-118, May 08-11, 2000, Santa Fe, New Mexico, United States [doi>10.1145/335231.335242]
• 18: E. N. (Mootaz) Elnozahy , Lorenzo Alvisi , Yi-Min Wang , David B. Johnson, A survey of rollback-recovery protocols in message-passing systems, ACM Computing Surveys (CSUR), v.34 n.3, p.375-408, September 2002 [doi>10.1145/568522.568525]
• 19: Graham E. Fagg , Jack Dongarra, FT-MPI: Fault Tolerant MPI, Supporting Dynamic Applications in a Dynamic World, Proceedings of the 7th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface, p.346-353, January 2000
• 20: Jamal Faik , Joseph E. Flaherty , James D. Teresco, A model for resource-aware load balancing on heterogeneous and non-dedicated clusters, Rensselaer Polytechnic Institute, Troy, NY, 2005
• 21: Fedorov, A., Chrisochoides, N., Kikinis, R., and Warfield, S. K. 2006. An evaluation of three approaches to tetrahedral mesh generation for deformable registration of MR images. In Proceedings of IEEE International Symposium on Biomedical Imaging: From Nano to Macro (ISBI 2006), 658--661.
• 22: Ferrant, M. 2001. Physics-based Deformable Modeling of Volumes and Surfaces for Medical Image Registration, Segmentation and Visualization. PhD thesis, Universite Catholique de Louvain.
• 23: Roy Friedman , Maxim Goldin , Ayal Itzkovitz , Assaf Schuster, MILLIPEDE: easy parallel programming in available distributed environments, Software—Practice & Experience, v.27 n.8, p.929-965, Aug. 1997 [doi>10.1002/(SICI)1097-024X(199708)27:8<929::AID-SPE113>3.0.CO;2-# ]
• 24: Golby, A. J., Poldrack, R. A., Illes, J., Chen, D., Desmond, J. E., and Gabrieli, J. D. 2002. Memory lateralization in medial temporal lobe epilepsy assessed by functional MRI. Epilepsia 43, 8, 855--863.
• 25: Internet2 consortium, 2006. Internet2 home page. http://www.internet2.edu/, accessed 23 April 2006.
• 26: Laxmikant V. Kale , Sanjeev Krishnan, CHARM++: a portable concurrent object oriented system based on C++, Proceedings of the eighth annual conference on Object-oriented programming systems, languages, and applications, p.91-108, September 26-October 01, 1993, Washington, D.C., United States
• 27: Scott R. Kohn , Scott B. Baden, Parallel software abstractions for structured adaptive mesh methods, Journal of Parallel and Distributed Computing, v.61 n.6, p.713-736, June 2001 [doi>10.1006/jpdc.2001.1700 ]
• 28: Rexilius, J., 2001. Physics-based nonrigid registration for medical image analysis. MS Thesis.
• 29: Sankaran, S., Squyres, J. M., Barrett, B., Lumsdaine, A., Duell, J., Hargrove, P., and Roman, E. 2005. The LAM/MPI checkpoint/restart framework: System-initiated checkpointing. International Journal of High Performance Computing Applications 19, 4, 479--493.
• 30: Snir, M., and Gropp, W. 1998. MPI: The Complete Reference. The MIT Press.
• 31: Talos, I. F., Walker, D., Zou, K., Kikinis, R., Jolesz, F., and Black, P. 2002. Factors affecting resectability of adult hemispheric low-grade gliomas under intraoperative MRI-guidance. European Radiology 12.
• 32: TeraGrid Project, 2006. TeraGrid Home page. http://teragrid.org/, accessed 23 April 2006.
• 33: James D. Teresco , Jamal Faik , Joseph E. Flaherty, Resource-Aware Scientific Computation on a Heterogeneous Cluster, Computing in Science and Engineering, v.7 n.2, p.40-50, March 2005 [doi>10.1109/MCSE.2005.38]
• 34: Warfield, S. K., Talos, F., Tei, A., Bharatha, A., Nabavi, A., Ferrant, M., Black, P., Jolesz, F. A., and Kikinis, R. 2002. Real-time registration of volumetric brain MRI by biomechanical simulation of deformation during image guided neurosurgery. Computing and Visualization in Science 5, 1, 3--11.
• 35: Warfield, S. K., Haker, S. J., Talos, I. F., Kemper, C. A., Weisenfeld, N., Mewes, A. U. J., Goldberg-Zimring, D., Zou, K. H., Westin, C. F., and Wells, W. M. 2005. Capturing intraoperative deformations: research experience at Brigham and Women's Hospital. Medical Image Analysis 9, 2, 145--162.
• 36: Wu, I. 1993. Multilist Scheduling: A New Parallel Programming Model. PhD thesis, School of Comp. Sci., Carnegie Mellon University, Pittsburg, PA 15213.
• 37: X. Yuan , C. Salisbury , D. Balsara , R. Melhem, A load balancing package on distributed memory systems and its application to particle-particle particle-mesh (P3M) methods, Parallel Computing, v.23 n.10, p.1525-1544, Oct. 1997 [doi>10.1016/S0167-8191(97)00063-X ]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.0 General
          Subjects: Image processing software

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.2 Graphics Systems
          Subjects: Distributed/network graphics
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.9 Applications
  I.5 PATTERN RECOGNITION
      I.5.2 Design Methodology

General Terms:
Design

Keywords:
distributed computing, grid computing, image registration, medical imaging