QoS for internet services: done right

ABSTRACT

In this paper we argue that the best approach to providing Quality of Service (QoS) guarantees to current Internet services is to use admission control and traffic shaping techniques at the entrance points of Internet hosting sites. We propose a black-box approach that does not require knowledge, instrumentation, or modification of the system (hardware and software) that implements the services provided by the site.We maintain that such a non-intrusive QoS solution achieves better resource utilization, has lower cost, and is more flexible than the current approaches of physical partitioning and hardware over-provisioning. Furthermore, we contend that our solution is easier to deploy, less complex to implement, and easier to maintain than more intrusive approaches which embed the QoS logic into the operating system, distributed middleware, or application code. We demonstrate empirically that despite being decoupled from the internal mechanisms implementing the site, a black-box approach provides effective response times and capacity guarantees.

REFERENCES

• 1: J. Almeida, M. Dabu, A. Manikutty, and P. Cao. Providing differentiated quality-of-service in Web hosting services. In Proceedings of the First Workshop on Internet Server Performance, June 1998.
• 2: Mohit Aron , Peter Druschel , Willy Zwaenepoel, Cluster reserves: a mechanism for resource management in cluster-based network servers, Proceedings of the 2000 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, p.90-101, June 18-21, 2000, Santa Clara, California, United States
• 3: Gaurav Banga , Peter Druschel , Jeffrey C. Mogul, Resource containers: a new facility for resource management in server systems, Proceedings of the third symposium on Operating systems design and implementation, p.45-58, February 1999, New Orleans, Louisiana, United States
• 4: N. Bhatti and R. Friedrich. Web server support for tiered services. IEEE Network, September 1999.
• 5: J. Blanquer, J. Bruno, E. Gabber, M. Mcshea, B. Özden, and A. Silberschatz. Resource Management for QoS in Eclipse/BSD. In Proceedings of the First FreeBSD Conference, Berkeley, California, Oct. 1999.
• 6: Josep M. Blanquer , Banu Özden, Fair queuing for aggregated multiple links, Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications, p.189-197, August 2001, San Diego, California, United States
• 7: Clarknet. http://ita.ee.lbl.gov/html/contrib/ClarkNet-HTTP.html.
• 8: A. Demers , S. Keshav , S. Shenker, Analysis and simulation of a fair queueing algorithm, Symposium proceedings on Communications architectures & protocols, p.1-12, September 25-27, 1989, Austin, Texas, United States
• 9: Sameh Elnikety , Erich Nahum , John Tracey , Willy Zwaenepoel, A method for transparent admission control and request scheduling in e-commerce web sites, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988710]
• 10: P. Gupta and N. McKeown. Algorithms for packet classification. IEEE Network Special Issue, March 2001.
• 11: Netscaler Request Switching Technology. http://www.netscaler.com.
• 12: Packeteer Traffic Management http://www.packeteer.com.
• 13: Abhay K. Parekh , Robert G. Gallager, A generalized processor sharing approach to flow control in integrated services networks: the single-node case, IEEE/ACM Transactions on Networking (TON), v.1 n.3, p.344-357, June 1993 [doi>10.1109/90.234856]
• 14: Kai Shen , Hong Tang , Tao Yang , Lingkun Chu, Integrated resource management for cluster-based internet services, Proceedings of the 5th symposium on Operating systems design and implementation

  Due to copyright restrictions we are not able to make the PDFs for this conference available for downloading

  , December 09-11, 2002, Boston, Massachusetts [doi>10.1145/1060289.1060311]
• 15: Apache Tomcat server. http://jakarta.apache.org/tomcat.
• 16: Thiemo Voigt , Renu Tewari , Douglas Freimuth , Ashish Mehra, Kernel Mechanisms for Service Differentiation in Overloaded Web Servers, Proceedings of the General Track: 2002 USENIX Annual Technical Conference, p.189-202, June 25-30, 2001
• 17: Matt Welsh , David Culler , Eric Brewer, SEDA: an architecture for well-conditioned, scalable internet services, Proceedings of the eighteenth ACM symposium on Operating systems principles, October 21-24, 2001, Banff, Alberta, Canada
• 18: Ronghua Zhang , Chenyang Lu , Tarek F. Abdelzaher , John A. Stankovic, ControlWare: A Middleware Architecture for Feedback Control of Software Performance, Proceedings of the 22 nd International Conference on Distributed Computing Systems (ICDCS'02), p.301, July 02-05, 2002
• 19: H. Zhu, H. Tang, and T. Yang. Demand-driven service differentiation in cluster-based network servers. In Proceedings of the IEEE INFOCOM, Anchorage, Alaska, April 2001.