Semantic image classification with hierarchical feature subset selection

ABSTRACT

High-dimensional visual features for image content characterization enables effective image classification. However, training accurate image classifiers in high-dimensional feature space suffers from the problem of curse of dimensionality and thus requires a large number of labeled images. To achieve accurate classifier training in high-dimensional feature space, we propose a hierarchical feature subset selection algorithm for semantic image classification, where the feature subset selection procedure is seamlessly integrated with the underlying classifier training procedure in a single algorithm. First, our hierarchical feature subset selection framework partitions the high-dimensional feature space into multiple homogeneous feature subspaces and forms a two-level feature hierarchy. Second, weak image classifiers are trained for each homogeneous feature subspace at the lower level of the feature hierarchy, where the traditional feature subset selection techniques such as principal component analysis (PCA) can be used for dimension reduction. Finally, these weak classifiers are boosted to determine an optimal image classifier and the higher-level feature subset selection is realized by selecting the most effective weak classifiers and their corresponding homogeneous feature subsets. Our experiments on a specific domain of natural images have obtained very positive results.

REFERENCES

• 1: Alicia Abella , John R. Kender, From Images to Sentences via Spatial Relations, Proceedings of the Integration of Speech and Image Understanding, p.117, September 21-21, 1999
• 2: H. Alexander and R. Lienhart. Automatic classification of images on the web. In SPIE, volume 4676, 2002.
• 3: Kobus Barnard , Pinar Duygulu , David Forsyth , Nando de Freitas , David M. Blei , Michael I. Jordan, Matching words and pictures, The Journal of Machine Learning Research, 3, 3/1/2003
• 4: K. Barnard and D. Forsyth. Learning the semantics of words and pictures. In ICCV, pages 408--415, 2001.
• 5: L. Breiman. Out-of-bag estimation. Technical report.
• 6: Leo Breiman, Bagging predictors, Machine Learning, v.24 n.2, p.123-140, Aug. 1996 [doi>10.1023/A:1018054314350 ]
• 7: Leo Breiman, Random Forests, Machine Learning, v.45 n.1, p.5-32, October 1 2001 [doi>10.1023/A:1010933404324 ]
• 8: Chad Carson , Serge Belongie , Hayit Greenspan , Jitendra Malik, Region-Based Image Querying, Proceedings of the 1997 Workshop on Content-Based Access of Image and Video Libraries (CBAIVL '97), p.42, June 20-20, 1997
• 9: A. Cavallaro, O. Steiger, and T. Ebrahimi. Tracking video objects in cluttered background. Circuits and Systems for Video Technology, IEEE Transactions on, 15(4):575--584, 2005.
• 10: E. Chang, B. Li, G. Wu, and K. Goh. Statistical learning for effective visual information retrieval. In ICIP, 2003.
• 11: S. Chang, W. Chen, and H. Sundaram. Semantic visual templates: linking visual features to semantics. In ICIP, 1998.
• 12: Yining Deng , b. s. Manjunath, Unsupervised Segmentation of Color-Texture Regions in Images and Video, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.23 n.8, p.800-810, August 2001 [doi>10.1109/34.946985 ]
• 13: Jianping Fan , Yuli Gao , Hangzai Luo, Multi-level annotation of natural scenes using dominant image components and semantic concepts, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027660]
• 14: Y. Freund and R. E. Schapire. Experiments with a new boosting algorithm. In International Conference on Machine Learning, pages 148--156, 1996.
• 15: Isabelle Guyon , Jason Weston , Stephen Barnhill , Vladimir Vapnik, Gene Selection for Cancer Classification using Support Vector Machines, Machine Learning, v.46 n.1-3, p.389-422, 2002
• 16: Mark D. Happel , Peter Bock, Analysis of a Fusion Method for Combining Marginal Classifiers, Proceedings of the First International Workshop on Multiple Classifier Systems, p.137-146, June 21-23, 2000
• 17: T. Hastie, R. Tibshirani, and J. H. Friedman. The Elements of Statistical Learning. Springer, August 2001.
• 18: Xiaofei He , Wei-Ying Ma , Oliver King , Mingjing Li , Hongjiang Zhang, Learning and inferring a semantic space from user's relevance feedback for image retrieval, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641080]
• 19: R. Jin, A. Hauptmann, and R. Yan. Image classification using a bigram model. In AAAI, 2003.
• 20: I. King and J. Zhong. Integrated probability function and its application to content-based image retrieval by relevance feedback. Pattern Recognition, 36, 2003.
• 21: Beitao Li , Kingshy Goh, Confidence-based dynamic ensemble for image annotation and semantics discovery, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957051]
• 22: A. Mojsilovic and J. a. Gomes. ISee: perceptual features for image library navigation. In SPIE, 2001.
• 23: P. Mulhem, W. Leow, and Y. Lee. Fuzzy conceptual graphs for matching images of natural scenes. In IJCAI, pages 1397--1404, 2001.
• 24: S. Satoh, Y. Idehara, H. Mo, and T. Hamada. Subject region segmentation in disparity maps for image retrieval. In ICIP, volume 2, pages 725--728, 2001.
• 25: Arnold W. M. Smeulders , Marcel Worring , Simone Santini , Amarnath Gupta , Ramesh Jain, Content-Based Image Retrieval at the End of the Early Years, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.12, p.1349-1380, December 2000 [doi>10.1109/34.895972 ]
• 26: J. Smith and S. Chang. Multi-stage classification of images from features and related text. In DELOS, 1997.
• 27: John R. Smith , Chung-Sheng Li, Image classification and querying using composite region templates, Computer Vision and Image Understanding, v.75 n.1-2, p.165-174, July/Aug. 1999 [doi>10.1006/cviu.1999.0771 ]
• 28: F. Souvannavong, B. Merialdo, and B. Huet. Latent semantic indexing for semantic content detection of video shots. In ICME, 2004.
• 29: Martin Szummer , Rosalind W. Picard, Indoor-Outdoor Image Classification, Proceedings of the 1998 International Workshop on Content-Based Access of Image and Video Databases (CAIVD '98), p.42, January 03-03, 1998
• 30: Simon Tong , Edward Chang, Support vector machine active learning for image retrieval, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada [doi>10.1145/500141.500159]
• 31: Antonio B. Torralba , Aude Oliva, Semantic Organization of Scenes Using Discriminant Structural Templates, Proceedings of the International Conference on Computer Vision-Volume 2, p.1253, September 20-25, 1999
• 32: A. Vailaya, M. Figueiredo, A. Jain, and H.-J. Zhang. Image classification for content-based indexing. Image Processing, IEEE Transactions on, 2001.
• 33: V. N. Vapnik. Statistical Learning Theory. Wiley-Interscience, September 1998.
• 34: James Z. Wang , Jia Li , Gio Wiederhold, SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.23 n.9, p.947-963, September 2001 [doi>10.1109/34.955109 ]
• 35: Zhao and etc. Narrowing the semantic gap - improved text-based web document retrieval using visual features. Multimedia, IEEE Transactions on, 2002.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.7 Feature Measurement
          Subjects: Feature representation

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.6 Learning
          Subjects: Concept learning

General Terms:
Algorithms, Experimentation

Keywords:
classifier training, feature selection, semantic image classification