Content aware video presentation on high-resolution displays

ABSTRACT

We describe a prototype video presentation system that presents a video in a manner consistent with the video's content. Our prototype takes advantage of the physically large display and pixel space that current high-definition displays and multi-monitor systems offer by rendering the frames of the video into various regions of the display surface. The structure of the video informs the animation, size, and the position of these regions. Additionally, previously displayed frames are often allowed to remain on-screen and are filtered over time. Our prototype presents a video in a manner that not only preserves the continuity of the story, but also supports the structure of the video; thus, the content of the video is reflected in its presentation, arguably enhancing the viewing experience.

References

1. Boreczky, J., Girgensohn, A., Golovchinsky, G., and Uchihashi, S. 2000. An interactive comic book presentation for exploring video. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (The Hague, The Netherlands, April 01--06, 2000). CHI '00. ACM Press, New York, NY, 185--192.
2. Brown, B. and Barkhuus, L. 2006. The television will be revolutionized: effects of PVRs and filesharing on television watching. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Montréal, Canada, 2006). CHI '06. ACM Press, New York, NY, 663--666.
3. Cabedo, X. U. and Bhattacharjee, S. K., Shot detection tools in digital video. In Proceedings of Nonlinear Model Based Image Analysis 1998 (Glasgow, July 1998). Springer Verlag, 121--126.
4. Cernekova, Z., Nikou, C., and Pitas, I. Shot Detection in Video Sequences Using Entropy-Based Metrics. International Conference on Image Processing 2002 (ICIP2002), Vol. 3, 421--424.
5. Fan, X., Xie, X., Zhou, H., and Ma, W. 2003. Looking into video frames on small displays. In Proceedings of the Eleventh ACM international Conference on Multimedia (Berkeley, CA, USA, November 02--08, 2003). MULTIMEDIA '03. ACM Press, New York, NY, 247--250.
6. Jones, R. C., DeMenthon, D., and Doermann, D. S. 1999. Building mosaics from video using MPEG motion vectors. In Proceedings of the Seventh ACM international Conference on Multimedia (Part 2) (Orlando, Florida, United States, October 30 - November 05, 1999). MULTIMEDIA '99. ACM Press, New York, NY, 29--32.
7. Lienhart, R. Comparison of Automatic Shot Boundary Detection Algorithms. In Image and Video Processing VII 1999, Proc. SPIE 3656--29, Jan. 1999.
8. Lu, X., Ma, Y.-F., Zhang, H.-J. and Wu, L., An Integrated Correlation Measure for Semantic Video Segmentation. In Proceedings of IEEE International Conference on Multimedia and Expo - ICME '02, (Lausanne, Switzerland, 2002), 57--60.
9. Mitsubishi Electric. RakuReko DVD Recorder. http://www.mitsubishielectric.co.jp/news/2006/0601.htm
10. Pilu, M., On Using Raw MPEG Motion Vectors To Determine Global Camera Motion, Digital Media Department, HP Laboratories, August 1997.
11. Shamma, D. A., Owsley, S., Hammond, K. J., Bradshaw, S., and Budzik, J. 2004. Network arts: exposing cultural reality. In Proceedings of the 13th international World Wide Web Conference on Alternate Track Papers & Posters (New York, NY, USA, May 19--21, 2004). WWW Alt. '04. ACM Press, New York, NY, 41--47.
12. Teodosio, L. and Bender, W. 1993. Salient video stills: content and context preserved. In Proceedings of the First ACM international Conference on Multimedia (Anaheim, California, United States, August 02--06, 1993). MULTIMEDIA '93. ACM Press, New York, NY, 39--46.
13. Varchmin, A. C., Rae, R., and Ritter, H. 1998. Image Based Recognition of Graze Direction Using Adaptive Methods. In Proceedings of the international Gesture Workshop on Gesture and Sign Language in Human-Computer interaction (September 17--19, 1997). I. Wachsmuth and M. Fröhlich, Eds. Lecture Notes In Computer Science, vol. 1371. Springer-Verlag, London, 245--257.
14. Viola, P. and Jones, M. J. Robust Real-Time Face Detection. International Journal of Computer Vision, 57 (2). 137--154.
15. Wittenburg, K., Forlines, C., Lanning, T., Esenther, A., Harada, S. and Miyachi, T., Rapid serial visual presentation techniques for consumer digital video devices. in Proceedings of the 16th annual ACM symposium on User interface software and technology, (Vancouver, Canada, 2003), ACM Press, 115--124.
16. Yeung, M. M. and Yeo, B. 1996. Time-Constrained Clustering for Segmentation of Video into Story Unites. In Proceedings of the international Conference on Pattern Recognition (ICPR '96) Volume Iii-Volume 7276 - Volume 7276 (August 25--29, 1996). ICPR. IEEE Computer Society, Washington, DC, 375.
17. L. Zhao, W. Qi. Y. J. Wang, S. Q. Yang, and H. J. Zhang. Video Shot Grouping Using Best-First Model Merging. Proc. 13th SPIE symposium on Electronic Imaging - Storage and Retrieval for Image and Video Databases, SPIE vol. 4315, pp. 262--269. Jan. 2001.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

        • Video segmentation

      • Computer vision tasks

        • Video summarization

      • Image and video acquisition