Video editing based on object movement and camera motion

ABSTRACT

The advancement of computer technology makes video devices/equipments powerful and inexpensive, and thereby the number of applications that can effectively utilize digital videos is increasing.In this paper, the authors propose a new type of video editing, which is based on the movement of objects. A video shot is automatically edited so that the selected objects are placed and kept at the center of the frames to make the resultant video more attractive. Ideally this is interpreted as applying pan, tilt, and/or zoom operations into a source video as post-conditions in video editing. Implementation issues for realization of this facility are also presented in this paper.

REFERENCES

• 1: Anurag Mittal , Larry S. Davis, M2Tracker: A Multi-view Approach to Segmenting and Tracking People in a Cluttered Scene Using Region-Based Stereo, Proceedings of the 7th European Conference on Computer Vision-Part I, p.18-36, May 28-31, 2002
• 2: J. Krumm, S. Harris, B. Meyers, B. Brumitt, M. Hale and S. Shafer, "Multi-camera Multi-person Tracking for EasyLiving", Proc. 2nd IEEE Workshop on Visual Surveillance, 1999.
• 3: G. Stein, "Tracking from Multiple View Points: Self-Calibration of Space and Time", Proc. IEEE CVPR Conference, pp. 521--527, 1999.
• 4: J. Kang, I. Cohen and G. Medioni, "Continuous Tracking Within and Across Camera Streams", Proc. IEEE Conference on Computer Vision and Pattern Recognition, 2003.
• 5: Ismail Haritaoglu , Davis Harwood , Larry S. David, W4: Real-Time Surveillance of People and Their Activities, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.8, p.809-830, August 2000 [doi>10.1109/34.868683 ]
• 6: N. Amamoto and A. Fujii, "Detecting Obstructions and Tracking Moving Objects by Image Processing Technique", Electronics and Comm. Japan, Part 3, vol. 82, no. 11, pp. 28--37, 1999.
• 7: N. Ohta, "A Statistical Approach to Background Suppression for Surveillance System", Proc. IEEE International Conference on Computer Vision, pp. 481--486, 2001.
• 8: G. L. Foresti, P. Moretti, V. Murino, G. Pettirossi, C. S. Regazzoni, "Hough-Based Extraction and Grouping of Symbolic Features", Proc. 5th Workshop (Prometheus), pp. 109--118, Oct. 1991.
• 9: Carlo Regazzoni, Adaptive Tracking of Multiple Non Rigid Objects in Cluttered Scenes, Proceedings of the International Conference on Pattern Recognition, p.7108, September 03-08, 2000
• 10: I. Cohen and G. Medioni, "Detecting and Tracking Moving Objects for Video Surveillance", IEEE Conference on Computer Vision and Pattern Recognition, pp. 319--325, 1999.
• 11: I. Haritaoglu , D. Harwood , L. S. Davis, W4: Who? When? Where? What? A Real Time System for Detecting and Tracking People, Proceedings of the 3rd. International Conference on Face & Gesture Recognition, p.222, April 14-16, 1998
• 12: Yiwei Wang , John F. Doherty , Robert E. Van Dyck, Moving Object Tracking in Video, Proceedings of the 29th Applied Imagery Pattern Recognition Workshop, p.95, October 16-18, 2000
• 13: Gesture Tracking and Recognition for Lecture Video Editing, Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 3, p.934-937, August 23-26, 2004 [doi>10.1109/ICPR.2004.415]
• 14: M. Hirakawa, K. Nakashita, "Video Editing with Change of Camera Motion", Proc. International Conference on Distributed Multimedia Systems, pp. 196--200, 2004.
• 15: Andreas Girgensohn , John Boreczky , Patrick Chiu , John Doherty , Jonathan Foote , Gene Golovchinsky , Shingo Uchihashi , Lynn Wilcox, A semi-automatic approach to home video editing, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.81-89, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354415]
• 16: Eric P. Bennett , Leonard McMillan, Proscenium: a framework for spatio-temporal video editing, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957049]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Tracking; Motion

General Terms:
Algorithms, Human Factors

Keywords:
camera motion, moving object tracking, multimedia computing, video editing