VRules: an effective association-based classifier for videos

ABSTRACT

Video classification is an important step towards multimedia understanding. Most state-of-the-art approaches which apply HMM to capture the temporal information of videos have the limitation by assuming that the current state of a video depends only on the immediate previous state. Nevertheless, this assumption may not hold for videos of various categories. In this paper, we present an effective video classifier which employs the association rule mining technique to discover the actual dependence relationship between video states. The discriminatory state transition patterns mined from different video categories are then used to perform classification. Besides capturing the association between states in the time space, we also capture the association between low-level features in spatial dimension to further distinguish the semantics of videos. Experimental results show that the performance of our association rule based classifier is quite promising.

REFERENCES

• 1: Chabane Djeraba, Association and Content-Based Retrieval, IEEE Transactions on Knowledge and Data Engineering, v.15 n.1, p.118-135, January 2003 [doi>10.1109/TKDE.2003.1161586 ]
• 2: J. Huang, Z. Liu, and Y. Wang. Joint video scene segmentation and classification based on hidden markov model. In Proceedings of Advances in Digital Libraries Conference, Santa Barbara, CA, 1998.
• 3: Wei-Hao Lin , Alexander Hauptmann, News video classification using SVM-based multimodal classifiers and combination strategies, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641075]
• 4: B. Liu, W. Hsu, and Y.Ma. Integrating classification and association rule mining. In Proceedings of SIGKDD, 1998.
• 5: C. Lu, M. Drew, and J. Au. An automatic video classification system based on combination of hmm and video summarization. In International Journal of Smart Engineering System Design, vol.5, no.1, 2003.
• 6: G. Wei, L. Agnihotri, and N. Dimitrova. Tv program classification based on face and text processing. In Proceedings of IEEE multimedia and Expo, New York, 2000.
• 7: H. Yi, D. Rajan, and L. Chia. An efficient video classification system based on hmm in compressed domain. In Proceedings of 4th PCM, 2003.
• 8: H. Yi, D. Rajan, and L. Chia. A unified approach to detection of shot boundaries and subshots in compressed video. In Proceedings of IEEE ICIP, 2003.
• 9: Mohammed J. Zaki , Charu C. Aggarwal, XRules: an effective structural classifier for XML data, Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, August 24-27, 2003, Washington, D.C. [doi>10.1145/956750.956787]
• 10: Wensheng Zhou , Asha Vellaikal , C. C. Jay Kuo, Rule-based video classification system for basketball video indexing, Proceedings of the 2000 ACM workshops on Multimedia, p.213-216, October 30-November 03, 2000, Los Angeles, California, United States [doi>10.1145/357744.357941]
• 11: X. Zhu and X. Wu. Sequential association mining for video summarization. In Proceedings of IEEE ICME, 2003.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

General Terms:
Management

Keywords:
association rule, frequent sequence, video classification