Abstract
The unprecedented and ever-growing number of Web videos nowadays leads to the massive existence of near-duplicate videos. Very often, some near-duplicate videos exhibit great content changes, while the user perceives little information change, for example, color features change significantly when transforming a color video with a blue filter. These feature changes contribute to low-level video similarity computations, making conventional similarity-based near-duplicate video retrieval techniques incapable of accurately capturing the implicit relationship between two near-duplicate videos with fairly large content modifications. In this paper, we introduce a new dimension for near-duplicate video retrieval. Different from existing near-duplicate video retrieval approaches which are based on video-content similarity, we explore the correlation between two videos. The intuition is that near-duplicate videos should preserve strong information correlation in spite of intensive content changes. More effective retrieval with stronger tolerance is achieved by replacing video-content similarity measures with information correlation analysis. Theoretical justification and experimental results prove the effectiveness of correlation-based near-duplicate retrieval.
- Assent, I. and Kremer, H. 2009. Robust adaptable video copy detection. In Proceedings of SSTD. 380--385. Google ScholarDigital Library
- Brown, M. and Lowe, D. G. 2002. Invariant features from interest point groups. In Proceedings of BMVC.Google Scholar
- Cherubini, M., de Oliveira, R., and Oliver, N. 2009. Understanding near-duplicate videos: a user-centric approach. In Proceedings of ACM Multimedia. 35--44. Google ScholarDigital Library
- Clark, D. 1975. Understanding Canonical Correlation Analysis. Geo Abstracts Ltd.Google Scholar
- Hardoon, D. R., Szedmák, S., and Shawe-Taylor, J. 2004. Canonical correlation analysis: An overview with application to learning methods. Neural Computat. 16, 12, 2639--2664. Google ScholarDigital Library
- Hotelling, H. 1936. Relations between two sets of variates. Biometrika 28, 3/4, 321--377.Google Scholar
- Huang, Z., Hu, B., Cheng, H., Shen, H. T., Liu, H., and Zhou, X. 2010. Mining near-duplicate graph for cluster-based reranking of web video search results. ACM Trans. Info. Syst. 28, 4. Google ScholarDigital Library
- Huang, Z., Shen, H. T., Shao, J., Zhou, X., and Cui, B. 2009. Bounded coordinate system indexing for real-time video clip search. ACM Trans. Info. Syst. 27, 3. Google ScholarDigital Library
- Jagadish, H. V., Ooi, B. C., Tan, K.-L., Yu, C., and Zhang, R. 2005. idistance: An adaptive b+-tree based indexing method for nearest neighbor search. ACM Trans. Data. Syst. 30, 2, 364--397. Google ScholarDigital Library
- Ke, Y. and Sukthankar, R. 2004. Pca-sift: A more distinctive representation for local image descriptors. In Proceedings of CVPR. 506--513. Google ScholarDigital Library
- Kim, T.-K. and Cipolla, R. 2009. Canonical correlation analysis of video volume tensors for action categorization and detection. IEEE Trans. Patt. Anal. Machine Intell. 31, 8, 1415--1428. Google ScholarDigital Library
- Kim, T.-K., Kittler, J., and Cipolla, R. 2007. Discriminative learning and recognition of image set classes using canonical correlations. IEEE Trans. Patt. Anal. Machine Intell. 29, 6, 1005--1018. Google ScholarDigital Library
- Law-To, J., Buisson, O., Gouet-Brunet, V., and Boujemaa, N. 2006. Robust voting algorithm based on labels of behavior for video copy detection. In Proceedings of ACM Multimedia. 835--844. Google ScholarDigital Library
- Law-To, J., Buisson, O., Gouet-Brunet, V., and Boujemaa, N. 2009. Vicopt: a robust system for content-based video copy detection in large databases. Multimedia Syst. 15, 6, 337--353.Google ScholarCross Ref
- Law-To, J., Chen, L., Joly, A., Laptev, I., Buisson, O., Gouet-Brunet, V., Boujemaa, N., and Stentiford, F. 2007. Video copy detection: a comparative study. In Proceedings of CIVR. 371--378. Google ScholarDigital Library
- Liu, L., Lai, W., Hua, X.-S., and Yang, S.-Q. 2007. Video histogram: A novel video signature for efficient web video duplicate detection. In Proceedings of MMM. 94--103. Google ScholarDigital Library
- Lowe, D. G. 2004. Distinctive image features from scale-invariant keypoints. Int. J. Computer Vision 60, 2, 91--110. Google ScholarDigital Library
- Mardia, K. V., Kent, J. T., and Bibby, J. M. 1980. Multivariate Analysis. Academic Press.Google Scholar
- Mikolajczyk, K. and Schmid, C. 2002. An affine invariant interest point detector. In Proceedings of ECCV. 128--142. Google ScholarDigital Library
- Mikolajczyk, K. and Schmid, C. 2004. Scale & affine invariant interest point detectors. Int. J. Computer Vision 60, 1, 63--86. Google ScholarDigital Library
- Ngo, C.-W., Zhao, W., and Jiang, Y.-G. 2006. Fast tracking of near-duplicate keyframes in broadcast domain with transitivity propagation. In Proceedings of ACM Multimedia. 845--854. Google ScholarDigital Library
- Poullot, S., Crucianu, M., and Buisson, O. 2008. Scalable mining of large video databases using copy detection. In Proceedings of ACM Multimedia. 61--70. Google ScholarDigital Library
- Satoh, S., Takimoto, M., and Adachi, J. 2007. Scene duplicate detection from videos based on trajectories of feature points. In Proceedings of MIR. 237--244. Google ScholarDigital Library
- seok Min, H., Choi, J., Neve, W. D., and Ro, Y. M. 2009. Near-duplicate video detection using temporal patterns of semantic concepts. In Proceedings of ISM. 65--71. Google ScholarDigital Library
- Shen, H. T., Liu, J., Huang, Z., Ngo, C.-W., and Wang, W. 2011. Near-duplicate video retrieval: Current research and future trends. IEEE Trans. Multimedia.Google ScholarCross Ref
- Shen, H. T., Zhou, X., Huang, Z., and Shao, J. 2007. Statistical summarization of content features for fast near-duplicate video detection. In Proceedings of ACM Multimedia. 164--165. Google ScholarDigital Library
- Shen, H. T., Zhou, X., Huang, Z., Shao, J., and Zhou, E. 2007. Uqlips: A real-time near-duplicate video clip detection system. In Proceedings of VLDB. 1374--1377. Google ScholarDigital Library
- Snedecor, G. W. and Cochran, W. G. 1989. Statistical Methods 8th Ed. Iowa State University Press.Google Scholar
- Tan, H.-K., Ngo, C.-W., Hong, R., and Chua, T.-S. 2009. Scalable detection of partial near-duplicate videos by visual-temporal consistency. In Proceedings of ACM Multimedia. 145--154. Google ScholarDigital Library
- Tan, H.-K., Wu, X., Ngo, C.-W., and Zhao, W. 2008. Accelerating near-duplicate video matching by combining visual similarity and alignment distortion. In Proceedings of ACM Multimedia. 861--864. Google ScholarDigital Library
- Wu, X., Hauptmann, A. G., and Ngo, C.-W. 2007. Practical elimination of near-duplicates from web video search. In Proceedings of ACM Multimedia. 218--227. Google ScholarDigital Library
- Wu, X., Takimoto, M., Satoh, S., and Adachi, J. 2008. Scene duplicate detection based on the pattern of discontinuities in feature point trajectories. In Proceedings of ACM Multimedia. 51--60. Google ScholarDigital Library
- Wu, X., Zhao, W., and Ngo, C.-W. 2007. Near-duplicate keyframe retrieval with visual keywords and semantic context. In Proceedings of CIVR. 162--169. Google ScholarDigital Library
- Wu, Z., Jiang, S., and Huang, Q. 2009. Near-duplicate video matching with transformation recognition. In Proceedings of ACM Multimedia. 549--552. Google ScholarDigital Library
- Yeh, M.-C. and Cheng, K.-T. 2009. Video copy detection by fast sequence matching. In Proceedings of CIVR. Google ScholarDigital Library
- Yuan, J., Duan, L.-Y., Tian, Q., and Xu, C. 2004. Fast and robust short video clip search using an index structure. In Proceedings of MIR. 61--68. Google ScholarDigital Library
- Zhang, X., Hua, G., 0001, L. Z., and Shum, H.-Y. 2010. Interest seam image. In Proceedings of CVPR. 3296--3303.Google Scholar
- Zhao, W. and Ngo, C.-W. 2009. Scale-rotation invariant pattern entropy for keypoint-based near-duplicate detection. IEEE Trans. Image Process. 18, 2, 412--423. Google ScholarDigital Library
- Zhao, W., Ngo, C.-W., Tan, H.-K., and Wu, X. 2007. Near-duplicate keyframe identification with interest point matching and pattern learning. IEEE Trans. Multimedia 9, 5, 1037--1048. Google ScholarDigital Library
- Zhu, J., Hoi, S. C. H., Lyu, M. R., and Yan, S. 2008. Near-duplicate keyframe retrieval by nonrigid image matching. In Proceedings of ACM Multimedia. 41--50. Google ScholarDigital Library
Index Terms
Correlation-based retrieval for heavily changed near-duplicate videos
Recommendations
Learn from Unlabeled Videos for Near-duplicate Video Retrieval
SIGIR '22: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information RetrievalNear-duplicate video retrieval (NDVR) aims to find the copies or transformations of the query video from a massive video database. It plays an important role in many video related applications, including copyright protection, tracing, filtering and etc. ...
Near-duplicate video retrieval: Current research and future trends
The exponential growth of online videos, along with increasing user involvement in video-related activities, has been observed as a constant phenomenon during the last decade. User's time spent on video capturing, editing, uploading, searching, and ...
Interactive near-duplicate video retrieval and detection
MM '09: Proceedings of the 17th ACM international conference on MultimediaVideo near-duplicate retrieval has become a compelling researching topic in recent years, due to the proliferation of online video uploading/sharing sites and the exponential explosion of video data. Previously, we introduced one new "realtime near-...
Comments