Tracking concept drifting with an online-optimized incremental learning framework

ABSTRACT

Concept drifting is an important and challenging research issue in the field of machine learning. This paper mainly addresses the issue of semantic concept drifting in time series such as video streams over a relatively long period of time. An Online-Optimized Incremental Learning framework is proposed as an example learning system for tracking the drifting concepts. Furthermore, a set of measures are defined to track the process of concept drifting in the learning system. These tracking measures are also applied to determine the corresponding parameters used for model updating in order to obtain the optimal up-to-date classifiers. Experiments on the data set of TREC Video Retrieval Evaluation 2004 not only demonstrate the inside concept drifting process of the learning system, but also prove that the proposed learning framework is promising for tackling the issue of concept drifting.

REFERENCES

• 1: A. Tsymbal, The problem of concept drift: definitions and related work, Available at http://www.cs.tcd.ie.
• 2: Gerhard Widmer , Miroslav Kubat, Learning in the presence of concept drift and hidden contexts, Machine Learning, v.23 n.1, p.69-101, April 1996 [doi>10.1023/A:1018046501280 ]
• 3: Ralf Klinkenberg , Thorsten Joachims, Detecting Concept Drift with Support Vector Machines, Proceedings of the Seventeenth International Conference on Machine Learning, p.487-494, June 29-July 02, 2000
• 4: R. Klinkenberg. Using Labeled and Unlabeled Data to Learn Drifting Concepts. IJCAI-2001 Workshop on Learning from Temporal and Spatial Data, pp 16--24.
• 5: Wei Fan, Systematic data selection to mine concept-drifting data streams, Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, August 22-25, 2004, Seattle, WA, USA [doi>10.1145/1014052.1014069]
• 6: Wei Fan, StreamMiner: A Classifier Ensemble-based Engine to Mine Concept Drifting, VLDB 2004.
• 7: Haixun Wang , Wei Fan , Philip S. Yu , Jiawei Han, Mining concept-drifting data streams using ensemble classifiers, Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, August 24-27, 2003, Washington, D.C. [doi>10.1145/956750.956778]
• 8: Mário Figueiredo , José M. N. Leitão , Anil K. Jain, On Fitting Mixture Models, Proceedings of the Second International Workshop on Energy Minimization Methods in Computer Vision and Pattern Recognition, p.54-69, July 26-29, 1999
• 9: S. Kullback, Information Theory and Statistics, J. Wiley & Sons, New York, 1959.
• 10: Mike West , Jeff Harrison, Bayesian forecasting and dynamic models (2nd ed.), Springer-Verlag New York, Inc., New York, NY, 1997
• 11: Jun Wu , Xian-Sheng Hua , Hong-Jiang Zhang , Bo Zhang, An online-optimized incremental learning framework for video semantic classification, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027601]
• 12: TREC Video Retrieval Evaluation (NIST, USA) Homepage. Available at: http://www-nlpir.nist.gov/projects/trecvid/
• 13: TREC Video Retrieval Evaluation Past Data. Available at: http://www-nlpir.nist.gov/projects/trecvid/trecvid.data.html
• 14: C.-Y. Lin, B. Tseng, J.R. Smith, IBM T.J. Watson Research Center, Video Collaborative Annotation Forum: Establishing Ground-Truth Labels on Large Multimedia Datasets, http://www-nlpir.nist.gov/projects/tvpubs/tvpapers03/ibm.final2.paper.pdf.
• 15: TREC Video Retrieval Evaluation Tools. Available at: http://www-nlpir.nist.gov/projects/trecvid/trecvid.tools/.
• 16: Scott H. Clearwater , Tze-Pin Cheng , Haym Hirsh , Bruce G. Buchanan, Incremental batch learning, Proceedings of the sixth international workshop on Machine learning, p.366-370, December 1989, Ithaca, New York, United States
• 17: D. A. Pomerleau, Efficient Training of artificial neural networks for autonomous navigation, Neural Computation, vol. 3, 1991.
• 18: Lei Zhang, F.Z Lin, Bo Zhang, A CBIR method based on color-spatial feature, IEEE Region 10 annual International Conference 1999 (TENCON'99), Cheju, Korea, 1999, pp 166--169.
• 19: Jing Huang , S. Ravi Kumar , Mandar Mitra , Wei-Jing Zhu , Ramin Zabih, Image Indexing Using Color Correlograms, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.762, June 17-19, 1997
• 20: TREC-10 Proceedings appendix on common evaluation measures. Available at: http://trec.nist.gov/pubs/trec10/appendices/measures.pdf.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: Video analysis

General Terms:
Algorithms, Experimentation

Keywords:
TREC video retrieval evaluation, concept drifting, gaussian mixture model, incremental learning, video content analysis