Video copy detection: a comparative study

ABSTRACT

This paper presents a comparative study of methods for video copy detection. Different state-of-the-art techniques, using various kinds of descriptors and voting functions, are described: global video descriptors, based on spatial and temporal features; local descriptors based on spatial, temporal as well as spatio-temporal information. Robust voting functions is adapted to these techniques to enhance their performance and to compare them. Then, a dedicated framework for evaluating these systems is proposed. All the techniques are tested and compared within the same framework, by evaluating their robustness under single and mixed image transformations, as well as for different lengths of video segments. We discuss the performance of each approach according to the transformations and the applications considered. Local methods demonstrate their superior performance over the global ones, when detecting video copies subjected to various transformations.

REFERENCES

• 1: http://www.bbc.co.uk/calc/news.
• 2: Dinkar N. Bhat , Shree K. Nayar, Ordinal Measures for Image Correspondence, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.20 n.4, p.415-423, April 1998 [doi>10.1109/34.677275 ]
• 3: L. Chen and F. W. M. Stentiford. Video sequence matching based on temporal ordinal measurement. Technical report no. 1, UCL Adastral, 2006.
• 4: B. Coskun, B. Sankur, and N. Memon. Spatio-temporal transform-based video hashing. IEEE Transactions on Multimedia, 8(6):1190--1208, 2006.
• 5: S. Eickeler , S. Muller, Content-based video indexing of TV broadcast news using hidden Markov models, Proceedings of the Acoustics, Speech, and Signal Processing, 1999. on 1999 IEEE International Conference, p.2997-3000, March 15-19, 1999 [doi>10.1109/ICASSP.1999.757471]
• 6: X. Fang, Q. Sun, and Q. Tian. Content-based video identification: a survey. In Int. Conf. Information Technology: Research and Education, 2003.
• 7: Martin A. Fischler , Robert C. Bolles, Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography, Communications of the ACM, v.24 n.6, p.381-395, June 1981 [doi>10.1145/358669.358692]
• 8: A. Hampapur and R. Bolle. Comparison of sequence matching techniques for video copy detection. In Conference on Storage and Retrieval for Media Databases, pages 194--201, 2002.
• 9: C. Harris and M. Stevens. A combined corner and edge detector. In 4th Alvey Vision Conference, pages 153--158, 1988.
• 10: X.-S. Hua, X. Chen, and H.-J. Zhang. Robust video signature based on ordinal measure. In International Conference on Image Processing, 2004.
• 11: P. Indyk, G. Iyengar, and N. Shivakumar. Finding pirated video sequences on the internet. Technical report, Stanford University, 1999.
• 12: K. Iwamoto, E. Kasutani, and A. Yamada. Image signature robust to caption superimposition for video sequence identification. In International Conference on Image Processing, 2006.
• 13: A. Joly, O. Buisson, and C. Frelicot. Content-based copy detection using distortion-based probabilistic similarity search. IEEE Transactions on Multimedia, 2007.
• 14: A. Joly, C. Frelicot, and O. Buisson. Feature statistical retrieval applied to content-based copy identification. In International Conference on Image Processing, 2004.
• 15: C. Kim and B. Vasudev. Spatiotemporal sequence matching techniques for video copy detection. IEEE Transactions on Circuits and Systems for Video Technology, 1(15):127--132, Jan. 2005.
• 16: Ivan Laptev , Tony Lindeberg, Space-time Interest Points, Proceedings of the Ninth IEEE International Conference on Computer Vision, p.432, October 13-16, 2003
• 17: Julien Law-To , Olivier Buisson , Valerie Gouet-Brunet , Nozha Boujemaa, Robust voting algorithm based on labels of behavior for video copy detection, Proceedings of the 14th annual ACM international conference on Multimedia, October 23-27, 2006, Santa Barbara, CA, USA [doi>10.1145/1180639.1180826]
• 18: Y. Li, L. Jin, and X. Zhou. Video matching using binary signature. In Int. Symposium on Intelligent Signal Processing and Communication Systems, pages 317--320, 2005.
• 19: R. Mohan. Video sequence matching. In Int. Conference on Audio, Speech and Signal Processing, 1998.
• 20: Job Oostveen , Ton Kalker , Jaap Haitsma, Feature Extraction and a Database Strategy for Video Fingerprinting, Proceedings of the 5th International Conference on Recent Advances in Visual Information Systems, p.117-128, March 11-13, 2002
• 21: Cordelia Schmid , Roger Mohr, Local Grayvalue Invariants for Image Retrieval, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.19 n.5, p.530-535, May 1997 [doi>10.1109/34.589215 ]
• 22: C. Tomasi and T. Kanade. Detection and tracking of point features. Technical report CMU-CS-91-132, Apr. 1991.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.9 Applications

General Terms:
Algorithms

Keywords:
content-based video copy detection