skip to main content
10.1145/2393347.2396368acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
poster

Client-side backprojection of presentation slides into educational video

Published:29 October 2012Publication History

ABSTRACT

A significant part of many videos of lectures is presentation slides that occupy much of the field of view. Further, for a student studying the lecture, having the slides sharply displayed is especially important, compared with the speaker, background, and audience. However, even if the original capture supports it, the bandwidth required for real time viewing is substantive, especially in the context of mobile devices. Here we propose reconstructing the video on the client side by backprojecting high resolution slide images into the video stream with the slide area blacked out. The high resolution slide deck can be sent once, and inserted into the video on the client side based on the transformation (a homography) computed in advance. We further introduce the idea that needed homography transformations can be approximated using affine transformations, which allows it to be done using built-in capabilities of HTML 5. We find that it is possible to significantly reduce bandwidth by compressing the modified video, while improving the slide area quality, but leaving the non-slide area roughly the same.

References

  1. Academic Earth. http://academicearth.org/.Google ScholarGoogle Scholar
  2. ffmpeg2theora. http://v2v.cc/~j/ffmpeg2theora/.Google ScholarGoogle Scholar
  3. Free Online MIT Course Materials. http://ocw.mit.edu/OcwWeb/web/courses/av/}.Google ScholarGoogle Scholar
  4. Open Yale Courses. http://oyc.yale.edu/courselist.Google ScholarGoogle Scholar
  5. Semantically Linked Instructional Content (SLIC). http://slic.arizona.edu/.Google ScholarGoogle Scholar
  6. UC Berkeley Webcasts. http://webcast.berkeley.edu/courses.php.Google ScholarGoogle Scholar
  7. Video Lectures. http://videolectures.net/.Google ScholarGoogle Scholar
  8. YouTube EDU. http://www.youtube.com/edu.Google ScholarGoogle Scholar
  9. E. Altman, Y. Chen, and W. C. Low. Semantic exploration of lecture videos. Proceedings of the tenth ACM international conference on Multimedia - MULTIMEDIA '02, page 416, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. N.-M. Cheung, D. Chen, V. Chandrasekhar, S. S. Tsai, G. Takacs, S. A. Halawa, and B. Girod. Restoration of out-of-focus lecture video by automatic slide matching. In Proceedings of the international conference on Multimedia, MM '10, pages 899--902, New York, NY, USA, 2010. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Q. Fan, A. Amir, K. Barnard, R. Swaminathan, and A. Efrat. Temporal modeling of slide change in presentation videos. In International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2007.Google ScholarGoogle ScholarCross RefCross Ref
  12. Q. Fan, K. Barnard, A. Amir, and A. Efrat. Accurate alignment of presentation slides with educational video. In IEEE International Conference on Multimedia & Expo (ICME), 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Q. Fan, K. Barnard, A. Amir, and A. Efrat. Robust spatiotemporal matching of electronic slides to presentation videos. IEEE Transactions on Image Processing, 20(8):2315--2328, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Q. Fan, K. Barnard, A. Amir, A. Efrat, and M. Lin. Matching slides to presentation videos using sift and scene background matching. In 8th ACM SIGMM International Workshop on Multimedia Information Retrieval, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. G. Gigonzac, F. Pitie, and A. Kokaram. Electronic slide matching and enhancement of a lecture video. IET Conference Publications, 2007(CP534):9--9, 2007.Google ScholarGoogle Scholar
  16. Q. Tung, R. Swaminathan, A. Efrat, and K. Barnard. Expanding the point: automatic enlargement of presentation video elements. In Proceedings of the 19th ACM international conference on Multimedia, MM '11, pages 961--964, New York, NY, USA, 2011. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. A. Winslow, Q. Tung, Q. Fan, J. Torkkola, R. Swaminathan, K. Barnard, A. Amir, A. Efrat, and C. Gniady. Studying on the move: enriched presentation video for mobile devices. In Proceedings of the 28th IEEE international conference on Computer Communications Workshops, INFOCOM'09, pages 224--229, Piscataway, NJ, USA, 2009. IEEE Press. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Client-side backprojection of presentation slides into educational video

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        MM '12: Proceedings of the 20th ACM international conference on Multimedia
        October 2012
        1584 pages
        ISBN:9781450310895
        DOI:10.1145/2393347

        Copyright © 2012 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 29 October 2012

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • poster

        Acceptance Rates

        Overall Acceptance Rate995of4,171submissions,24%

        Upcoming Conference

        MM '24
        MM '24: The 32nd ACM International Conference on Multimedia
        October 28 - November 1, 2024
        Melbourne , VIC , Australia
      • Article Metrics

        • Downloads (Last 12 months)3
        • Downloads (Last 6 weeks)0

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader