ABSTRACT
Faithful sharing of screen contents is an important collaboration feature. Prior systems were designed to operate over constrained networks. They performed poorly even without such bottlenecks. To build a high performance screen sharing system, we empirically analyzed screen contents for a variety of scenarios. We showed that screen updates were sporadic with long periods of inactivity. When active, screens were updated at far higher rates than was supported by earlier systems. The mismatch was pronounced for interactive scenarios. Even during active screen updates, the number of updated pixels were frequently small. We showed that crucial information can be lost if individual updates were merged. When the available system resources could not support high capture rates, we showed ways in which updates can be effectively collapsed. We showed that Zlib lossless compression performed poorly for screen updates. By analyzing the screen pixels, we developed a practical transformation that significantly improved compression rates. Our system captured 240 updates per second while only using 4.6 Mbps for interactive scenarios. Still, while playing movies in fullscreen mode, our approach could not achieve higher capture rates than prior systems; the CPU remains the bottleneck. A system that incorporates our findings is deployed within the lab.
- Apple - OS X mountain lion. http://www.apple.com/osx/.Google Scholar
- Demoforge mirage driver (dfmirage video hook driver). http://www.demoforge.com/dfmirage.htm.Google Scholar
- GLUT and OpenGL utility libraries. http://www.opengl.org/resources/libraries/glx/.Google Scholar
- Laptop to TV with Intel® wireless display (WiDi). http://www.intel.com/content/www/us/en/architecture-and-technology/intel-wireless-display.html.Google Scholar
- Remote desktop connection. http://windows.microsoft.com/en-US/windows7/products/features/remote-desktop-connection.Google Scholar
- Stream movies and music wirelessly with airplay. http://www.apple.com/ipad/features/airplay/.Google Scholar
- WHDI - wireless home digital interface. www.whdi.org.Google Scholar
- Windows 8 release preview. http://windows.microsoft.com/en-US/windows-8/release-preview.Google Scholar
- Windows mirror drivers. http://msdn.microsoft.com/library/ff568315.aspx.Google Scholar
- Multimedia redirection improvements in Windows 7 and WS2008 R2. http://goo.gl/W7Uv4, July 2009.Google Scholar
- Boyaci, O., and Schulzrinne, H. Bass application sharing system. In IEEE International Symposium on Multimedia (Berkeley, CA, USA, 2008), ISM '08, pp. 432--439. Google ScholarDigital Library
- CCITT Recommendation T.81. Digital Compression and Coding of Continous-Tone Still Images - Requirements and guidelines. International Telecommunication Union(ITU), Geneva, Sept. 1992.Google Scholar
- Chandra, S., and Rowe, L. A. DisplayCast: a high performance screen sharing system for intranets. In ACM Multimedia 2012 (Nara, Japan, Oct. 2012). https://github.com/DisplayCast. Google ScholarDigital Library
- Deutsch, P. Deflate compressed data format specification version 1.3. RFC 1951, May 1996. Google ScholarDigital Library
- Estes, C. D., and Mayer-Patel, K. The n-dimensional display interface: a more elastic narrow waist for the display pipeline. In MMSys '12 (Chapel Hill, NC, USA, Feb. 2012), pp. 119--129. Google ScholarDigital Library
- Hilbert, D. M., Turner, T., Denoue, L., and Sankarpandian, K. Autonomous presentation capture in corporate and educational settings. In IADIS e-Learning'08 (Amsterdam, The Netherlands, July 2008), pp. 239--246.Google Scholar
- Humphreys, G., Eldridge, M., Buck, I., Stoll, G., Everett, M., and Hanrahan, P. WireGL: a scalable graphics system for clusters. In SIGGRAPH '01 (Los Angeles, CA, USA, 2001), pp. 129--140. Google ScholarDigital Library
- Kim, H., Jeong, J., Hwang, J., Lee, J., and Maeng, S. Scheduler support for video-oriented multimedia on client-side virtualization. In MMSys '12 (Chapel Hill, NC, USA, 2012), pp. 65--76. Google ScholarDigital Library
- loup Gailly, J., and Adler, M. zlib: A massively spiffy yet delicately unobtrusive compression library. zlib.net.Google Scholar
- Richardson, T., and Levine, J. The remote framebuffer protocol. RFC 6143, Mar. 2011.Google Scholar
- Richardson, T., Stafford-Fraser, Q., Wood, K. R., and Hopper, A. Virtual network computing. IEEE Internet Computing 2 (Jan. 1998), 33--38. Google ScholarDigital Library
- Satoshi, U. MetaVNC - a window aware VNC. http://metavnc.sourceforge.net/.Google Scholar
- Schmidt, B. K., Lam, M. S., and Northcutt, J. D. The interactive performance of slim: a stateless, thin-client architecture. In SOSP '99 (Charleston, SC, USA, 1999), pp. 32--47. Google ScholarDigital Library
- Sun, Y., and Tay, T.-T. Analysis and reduction of data spikes in thin client computing. J. Parallel Distrib. Comput. 68, 11 (Nov. 2008), 1463--1472. Google ScholarDigital Library
- von Hoffman, J. T. Guide to Distributed PowerPoint. Boston University, 2001.Google Scholar
- Wallace, G., and Li, K. Virtually shared displays and user input devices. In USENIX Annual Technical Conference '07 (Santa Clara, CA, USA, June 2007), pp. 375--380. Google ScholarDigital Library
- Yun, H. C., Guenter, B. K., and Mersereau, R. M. Lossless compression of computer generated animation frames. ACM Trans. Graph. 16 (October 1997), 359--396. Google ScholarDigital Library
- Zero configuration networking (zeroconf). http://www.zeroconf.org/.Google Scholar
- Ziv, J., and Lempel, A. A universal algorithm for sequential data compression. IEEE Transactions on Information Theory 23, 3 (May 1977), 337--343. Google ScholarDigital Library
Index Terms
- Understanding screen contents for building a high performance, real time screen sharing system
Recommendations
High performance many-to-many intranet screen sharing with DisplayCast
DisplayCast is a many to many Intranet screen sharing system. Its screen capture mechanism creates a sequence of pixmap images of the screen updates. Prior systems that used a similar approach were designed to operate over constrained wide-area networks ...
A High-Fidelity and Low-Interaction-Delay Screen Sharing System
The pervasive computing environment and wide network bandwidth provide users more opportunities to share screen content among multiple devices. In this article, we introduce a remote display system to enable screen sharing among multiple devices with ...
DisplayCast: a high performance screen sharing system for intranets
MM '12: Proceedings of the 20th ACM international conference on MultimediaDisplayCast is a many to many screen sharing system that is targeted towards Intranet scenarios. The capture software runs on all computers whose screens need to be shared. It uses an application agnostic screen capture mechanism that creates a sequence ...
Comments