Texture based medical image indexing and retrieval: application to cardiac imaging

ABSTRACT

Although digital images indexing and querying techniques have extensively been studied for the last years, few systems are dedicated to medical images today while the need for content-based analysis and retrieval tools increases with the growth of digital medical image databases. We analyze medical image properties and we evaluate Gabor-filter based features extraction for medical images indexing and classification. The goal is to perform clinically relevant queries on large image databases that do not require user supervision. We demonstrate on the concrete case of cardiac imaging that these techniques can be used for indexing, retrieval by similarity queries, and to some extent, extracting clinically relevant information out of the images

REFERENCES

• 1: J. Bach, C. Fuller, A. Gupta, A. Hampapur, B. Horowitz, R. Humphrey, and R. Jain. Virage image search engine : An open framework for image management. In SPIE Storage and Retrieval for Image and Video Databases, volume 2670, pages 76--87, San Diego/La Jolla, CA, Jan. 1996.
• 2: A. C. Bovik , M. Clark , W. S. Geisler, Multichannel Texture Analysis Using Localized Spatial Filters, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.12 n.1, p.55-73, January 1990 [doi>10.1109/34.41384 ]
• 3: Chad Carson , Megan Thomas , Serge Belongie , Joseph M. Hellerstein , Jitendra Malik, Blobworld: A System for Region-Based Image Indexing and Retrieval, Proceedings of the Third International Conference on Visual Information and Information Systems, p.509-516, June 02-04, 1999
• 4: Wesley W. Chu , Chih-Cheng Hsu , Alfonso F. Cárdenas , Ricky K. Taira, Knowledge-Based Image Retrieval with Spatial and Temporal Constructs, IEEE Transactions on Knowledge and Data Engineering, v.10 n.6, p.872-888, November 1998 [doi>10.1109/69.738355 ]
• 5: D. Clausi and M. Jernigan. Designing gabor filters for optimal texture separability. Pattern Recognition, 33:1835--1849, Jan. 2000.
• 6: Dorin Comaniciu , Peter Meer , David Foran , Attila Medl, Bimodal System for Interactive Indexing and Retrieval of Pathology Images, Proceedings of the 4th IEEE Workshop on Applications of Computer Vision (WACV'98), p.76, October 19-21, 1998
• 7: Myron Flickner , Harpreet Sawhney , Wayne Niblack , Jonathan Ashley , Qian Huang , Byron Dom , Monika Gorkani , Jim Hafner , Denis Lee , Dragutin Petkovic , David Steele , Peter Yanker, Query by Image and Video Content: The QBIC System, Computer, v.28 n.9, p.23-32, September 1995 [doi>10.1109/2.410146 ]
• 8: R. Haralick, K. Shanmugam, and I. Dinstein. Textural features for image classification. IEEE Transactions Systems on Man and Cybernetics, 3(6):610--621, 1973.
• 9: T. S. Huang, S. Mehrotra, and K. Ramchandran. Multimedia Analysis and Retrieval System (MARS) project. In Proceedings of 33rd Annual Clinic on Library Application of Data processing - Digital Image Access and Retrieval, pages 100--117, Urbana/Champaign, Illinois, 1996.
• 10: Anil K. Jain , Richard C. Dubes, Algorithms for clustering data, Prentice-Hall, Inc., Upper Saddle River, NJ, 1988
• 11: A. Kak and C. Pavlopoulou. Content-Based Image Retrieval from Large Medical Databases. In 3D Data Processing, Visualization, Transmission, Padova, Italy, June 2002.
• 12: P. Kelly and T. Cannon. Query by image example: the candid approach. In Storage and Retrieval for Image and Video Databases III, volume 2420, pages 238--248. SPIE, 1995.
• 13: Philip (Flip) Korn , Nicholas Sidiropoulos , Christos Faloutsos , Eliot Siegel , Zenon Protopapas, Fast and Effective Retrieval of Medical Tumor Shapes, IEEE Transactions on Knowledge and Data Engineering, v.10 n.6, p.889-904, November 1998 [doi>10.1109/69.738356 ]
• 14: T. Lehmann, B. Wein, J. Dahmen, J. Bredno, F. Vogelsang, and M. Kohnen. Content-Based Image Retrieval in Medical Applications : A Novel Multi-Step Approach. In International Society for Optical Engineering (SPIE), volume 3972(32), pages 312--320, Feb. 2000.
• 15: W. Y. Ma , B. S. Manjunath, NeTra: a toolbox for navigating large image databases, Proceedings of the 1997 International Conference on Image Processing (ICIP '97) 3-Volume Set-Volume 1, p.568, October 26-29, 1997
• 16: B. Manjunath, P. Wu, S. Newsam, and H. Shin. A texture descriptor for browsing and similarity retrieval. Journal of Signal Processing : Image Communication, 16(1-2):33--43, 2000.
• 17: J. Montagnat, V. Breton, and I. Magnin. Partitionning medical image databases for content-based queries on a grid. to appear in Methods of Information in Medicine, 2004.
• 18: H. Müller, N. Michoux, D. Bandon, and A. Geissbuhler. A review of content-based image retrieval systems in medical applications - clinical benefits and future directions. International Journal of Medical Informatics, 73(1):1--23, Feb. 2004.
• 19: A. Pentland , R. W. Picard , S. Sclaroff, Photobook: content-based manipulation of image databases, International Journal of Computer Vision, v.18 n.3, p.233-254, June 1996 [doi>10.1007/BF00123143]
• 20: Alexis Roche , Grégoire Malandain , Xavier Pennec , Nicholas Ayache, The Correlation Ratio as a New Similarity Measure for Multimodal Image Registration, Proceedings of the First International Conference on Medical Image Computing and Computer-Assisted Intervention, p.1115-1124, October 11-13, 1998
• 21: D. Russakoff, C. Tomasi, T. Rohlfing, and C. Maurer, Jr. Image similarity using mutual information of regions. In ECCV04, pages Vol III: 596--607, 2004.
• 22: Chi-Ren Shyu , Carla E. Brodley , Avinash C. Kak , Akio Kosaka , Alex M. Aisen , Lynn S. Broderick, ASSERT: a physician-in-the-loop content-based retrieval system for HRCT image databases, Computer Vision and Image Understanding, v.75 n.1-2, p.111-132, July/Aug. 1999 [doi>10.1006/cviu.1999.0768 ]
• 23: J. Smith and S. Chang. Automated binary texture feature sets for image retrieval. In IEEE International Conference on Acoustics, Speech, and Signal Processing, volume 4, pages 2239--2242, May 1996.
• 24: John R. Smith , Shih-Fu Chang, VisualSEEk: a fully automated content-based image query system, Proceedings of the fourth ACM international conference on Multimedia, p.87-98, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244151]
• 25: H. D. Tagare, C. C. Jaffe, and J. Duncan. Medical Image Databases: A Content-based Retrieval Approach. J Am Med Inform Assoc, 4(3):184--198, 1997.
• 26: H. Tamura, S. Mori, and T. Yamawaki. Texture features corresponding to visual perception. IEEE Transacrions on Systems, Man and Cybernetics, 6(4):460--473, 1976.
• 27: M. Tuceryan and A. Jain. The Handbook of Pattern Recognition and Computer Vision (2nd Edition), chapter 2.1, pages 207--248. World Scientific Publishing Company, C.H. Chen, L.F. Pau, and P.S.P. Wang Eds., 1998.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Experimentation, Management

Keywords:
indexing, medical imaging, retrieval, segmentation, texture