skip to main content
10.1145/2393347.2393404acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Understanding screen contents for building a high performance, real time screen sharing system

Published:29 October 2012Publication History

ABSTRACT

Faithful sharing of screen contents is an important collaboration feature. Prior systems were designed to operate over constrained networks. They performed poorly even without such bottlenecks. To build a high performance screen sharing system, we empirically analyzed screen contents for a variety of scenarios. We showed that screen updates were sporadic with long periods of inactivity. When active, screens were updated at far higher rates than was supported by earlier systems. The mismatch was pronounced for interactive scenarios. Even during active screen updates, the number of updated pixels were frequently small. We showed that crucial information can be lost if individual updates were merged. When the available system resources could not support high capture rates, we showed ways in which updates can be effectively collapsed. We showed that Zlib lossless compression performed poorly for screen updates. By analyzing the screen pixels, we developed a practical transformation that significantly improved compression rates. Our system captured 240 updates per second while only using 4.6 Mbps for interactive scenarios. Still, while playing movies in fullscreen mode, our approach could not achieve higher capture rates than prior systems; the CPU remains the bottleneck. A system that incorporates our findings is deployed within the lab.

References

  1. Apple - OS X mountain lion. http://www.apple.com/osx/.Google ScholarGoogle Scholar
  2. Demoforge mirage driver (dfmirage video hook driver). http://www.demoforge.com/dfmirage.htm.Google ScholarGoogle Scholar
  3. GLUT and OpenGL utility libraries. http://www.opengl.org/resources/libraries/glx/.Google ScholarGoogle Scholar
  4. Laptop to TV with Intel® wireless display (WiDi). http://www.intel.com/content/www/us/en/architecture-and-technology/intel-wireless-display.html.Google ScholarGoogle Scholar
  5. Remote desktop connection. http://windows.microsoft.com/en-US/windows7/products/features/remote-desktop-connection.Google ScholarGoogle Scholar
  6. Stream movies and music wirelessly with airplay. http://www.apple.com/ipad/features/airplay/.Google ScholarGoogle Scholar
  7. WHDI - wireless home digital interface. www.whdi.org.Google ScholarGoogle Scholar
  8. Windows 8 release preview. http://windows.microsoft.com/en-US/windows-8/release-preview.Google ScholarGoogle Scholar
  9. Windows mirror drivers. http://msdn.microsoft.com/library/ff568315.aspx.Google ScholarGoogle Scholar
  10. Multimedia redirection improvements in Windows 7 and WS2008 R2. http://goo.gl/W7Uv4, July 2009.Google ScholarGoogle Scholar
  11. Boyaci, O., and Schulzrinne, H. Bass application sharing system. In IEEE International Symposium on Multimedia (Berkeley, CA, USA, 2008), ISM '08, pp. 432--439. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. CCITT Recommendation T.81. Digital Compression and Coding of Continous-Tone Still Images - Requirements and guidelines. International Telecommunication Union(ITU), Geneva, Sept. 1992.Google ScholarGoogle Scholar
  13. Chandra, S., and Rowe, L. A. DisplayCast: a high performance screen sharing system for intranets. In ACM Multimedia 2012 (Nara, Japan, Oct. 2012). https://github.com/DisplayCast. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Deutsch, P. Deflate compressed data format specification version 1.3. RFC 1951, May 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Estes, C. D., and Mayer-Patel, K. The n-dimensional display interface: a more elastic narrow waist for the display pipeline. In MMSys '12 (Chapel Hill, NC, USA, Feb. 2012), pp. 119--129. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Hilbert, D. M., Turner, T., Denoue, L., and Sankarpandian, K. Autonomous presentation capture in corporate and educational settings. In IADIS e-Learning'08 (Amsterdam, The Netherlands, July 2008), pp. 239--246.Google ScholarGoogle Scholar
  17. Humphreys, G., Eldridge, M., Buck, I., Stoll, G., Everett, M., and Hanrahan, P. WireGL: a scalable graphics system for clusters. In SIGGRAPH '01 (Los Angeles, CA, USA, 2001), pp. 129--140. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Kim, H., Jeong, J., Hwang, J., Lee, J., and Maeng, S. Scheduler support for video-oriented multimedia on client-side virtualization. In MMSys '12 (Chapel Hill, NC, USA, 2012), pp. 65--76. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. loup Gailly, J., and Adler, M. zlib: A massively spiffy yet delicately unobtrusive compression library. zlib.net.Google ScholarGoogle Scholar
  20. Richardson, T., and Levine, J. The remote framebuffer protocol. RFC 6143, Mar. 2011.Google ScholarGoogle Scholar
  21. Richardson, T., Stafford-Fraser, Q., Wood, K. R., and Hopper, A. Virtual network computing. IEEE Internet Computing 2 (Jan. 1998), 33--38. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Satoshi, U. MetaVNC - a window aware VNC. http://metavnc.sourceforge.net/.Google ScholarGoogle Scholar
  23. Schmidt, B. K., Lam, M. S., and Northcutt, J. D. The interactive performance of slim: a stateless, thin-client architecture. In SOSP '99 (Charleston, SC, USA, 1999), pp. 32--47. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Sun, Y., and Tay, T.-T. Analysis and reduction of data spikes in thin client computing. J. Parallel Distrib. Comput. 68, 11 (Nov. 2008), 1463--1472. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. von Hoffman, J. T. Guide to Distributed PowerPoint. Boston University, 2001.Google ScholarGoogle Scholar
  26. Wallace, G., and Li, K. Virtually shared displays and user input devices. In USENIX Annual Technical Conference '07 (Santa Clara, CA, USA, June 2007), pp. 375--380. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Yun, H. C., Guenter, B. K., and Mersereau, R. M. Lossless compression of computer generated animation frames. ACM Trans. Graph. 16 (October 1997), 359--396. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Zero configuration networking (zeroconf). http://www.zeroconf.org/.Google ScholarGoogle Scholar
  29. Ziv, J., and Lempel, A. A universal algorithm for sequential data compression. IEEE Transactions on Information Theory 23, 3 (May 1977), 337--343. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Understanding screen contents for building a high performance, real time screen sharing system

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      MM '12: Proceedings of the 20th ACM international conference on Multimedia
      October 2012
      1584 pages
      ISBN:9781450310895
      DOI:10.1145/2393347

      Copyright © 2012 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 29 October 2012

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      Overall Acceptance Rate995of4,171submissions,24%

      Upcoming Conference

      MM '24
      MM '24: The 32nd ACM International Conference on Multimedia
      October 28 - November 1, 2024
      Melbourne , VIC , Australia

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader