Learning image manifolds by semantic subspace projection

ABSTRACT

In many image retrieval applications, the mapping between high-level semantic concept and low-level features is obtained through a learning process. Traditional approaches often assume that images with same semantic label share strong visual similarities and should be clustered together to facilitate modeling and classification. Our research indicates this assumption is inappropriate in many cases. Instead we model the images as lying on non-linear image subspaces embedded in the high-dimensional space and find that multiple subspaces may correspond to one semantic concept.

REFERENCES

• 1: Arnold W. M. Smeulders , Marcel Worring , Simone Santini , Amarnath Gupta , Ramesh Jain, Content-Based Image Retrieval at the End of the Early Years, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.12, p.1349-1380, December 2000 [doi>10.1109/34.895972 ]
• 2: Q. Tian, J. Yu, Q. Xue, N. Sebe, "A New Analysis of the Value of Unlabeled Data in Semi-Supervised Learning for Image Retrieval," Proceedings of International Conference on Multimedia and Exposition, Taipei, Taiwan, ROC, June 27--30, 2004.
• 3: I. T. Jolliffe, Principal Component Analysis, 2nd edition, New-York: Springer-Verlag, 2002.
• 4: Richard O. Duda , Peter E. Hart , David G. Stork, Pattern Classification (2nd Edition), Wiley-Interscience, 2000
• 5: Daniel L. Swets , John Weng, Using Discriminant Eigenfeatures for Image Retrieval, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.18 n.8, p.831-836, August 1996 [doi>10.1109/34.531802 ]
• 6: S. Roweis and L. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, 290:2323--2326, December 2000.
• 7: J. B. Tenenbaum, V. de Silva and J. C. Langford. "A global geometric framework for nonlinear dimensionality reduction," Science, 290: 2319--2323, December 2000.
• 8: M. Belkin and P. Niyogi. "Laplacian eigenmaps and spectral techniques for embedding and clustering," Neural Information Processing Systems, 2001.
• 9: X. He and P. Niyogi, "Locality preserving projections," Neural Information Processing Systems 16 (NIPS'2003).
• 10: Xiaofei He, Incremental semi-supervised subspace learning for image retrieval, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027530]
• 11: Xiaofei He , Wei-Ying Ma , Hong-Jiang Zhang, Learning an image manifold for retrieval, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027532]
• 12: Manli Zhu , Aleix M. Martínez, Optimal Subclass Discovery for Discriminant Analysis, Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 6, p.97, June 27-July 02, 2004
• 13: Mario A. T. Figueiredo , Anil K. Jain, Unsupervised Learning of Finite Mixture Models, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.3, p.381-396, March 2002 [doi>10.1109/34.990138 ]
• 14: R. Duin, E. Pekalska, P. Paclik, and D. Tax, "The dissimilarity representation, a basis for domain based pattern recognition?", ICPR 2004 Workshop Proceedings, Cambridge UK, 22 August 2004.
• 15: D. de Ritter et al. "Supervised locally linear embedding," Proc. of ICANN/ICONIP, 2003
• 16: Hwann-Tzong Chen , Huang-Wei Chang , Tyng-Luh Liu, Local Discriminant Embedding and Its Variants, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2, p.846-853, June 20-26, 2005 [doi>10.1109/CVPR.2005.216]
• 17: Yen-Yu Lin , Tyng-Luh Liu , Hwann-Tzong Chen, Semantic manifold learning for image retrieval, Proceedings of the 13th annual ACM international conference on Multimedia, November 06-11, 2005, Hilton, Singapore [doi>10.1145/1101149.1101193]
• 18: Y. Rui, T. Huang, and S. Mehrotra. "Content-based image retrieval with relevance feedback in mars," In Int'l Conference on Image Processing, pages 815--818,1997.
• 19: Y. Rui and T. Huang, "Relevance feedback: A power tool for interactive content-based image retrieval," IEEE Trans. on Circuits and Video Tech., Special Issue on Segmentation Description, and Retrieval of Video Content, vol. 8, 1998.
• 20: S. X. Zhou and Thomas S. Huang. "Relevance feedback for image retrieval: a comprehensive review," Multimedia Systems, 8(6):536--544, 2003.
• 21: Peter N. Belhumeur , João P. Hespanha , David J. Kriegman, Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.19 n.7, p.711-720, July 1997 [doi>10.1109/34.598228 ]
• 22: F. Samaria and A. Harter, "Parameterisation of a stochastic model for human face identification," Proceedings of 2nd IEEE Workshop on Applications of Computer Vision, Sarasota FL, December 1994.
• 23: D. Graham and N. Allinson, "Characterizing virtual eigensignatures for general purpose face recognition," Face Recognition: From Theory to Applications, NATO ASI Series F, Computer and Systems Sciences, Vol. 163, pp.446--456, 1998.
• 24: Michael J. Swain , Dana H. Ballard, Color indexing, International Journal of Computer Vision, v.7 n.1, p.11-32, Nov. 1991 [doi>10.1007/BF00130487]
• 25: M. Stricker and M. Orengo, "Similarity of color images," Proc. SPIE Storage and Retrieval for Image and Video Databases, pp. 381--392. 1995.
• 26: J. R. Smith and S. F. Chang, "Transform features for texture classification and discrimination in large image database", IEEE Intl. Conf. on Image Proc., 1994
• 27: S. X. Zhou, Y. Rui, and T. S. Huang, "Water-filling algorithm: a novel way for image feature extraction based on edge maps," IEEE Intl. Conf. on Image Proc., 1999.
• 28: S. X. Zhou and Thomas S. Huang, "Small sample learning during multimedia retrieval using BiasMap," Proc. of IEEE Conference on Computer Vision and Pattern Recognition, December 2001.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods

General Terms:
Algorithms, Experimentation, Measurement, Performance, Theory

Keywords:
image retrieval, relevance, semantic subspace projection