Cluster reserves: a mechanism for resource management in cluster-based network servers

ABSTRACT

In network (e.g., Web) servers, it is often desirable to isolate the performance of different classes of requests from each other. That is, one seeks to achieve that a certain minimal proportion of server resources are available for a class of requests, independent of the load imposed by other requests. Recent work demonstrates how to achieve this performance isolation in servers consisting of a single, centralized node; however, achieving performance isolation in a distributed, cluster based server remains a problem.This paper introduces a new abstraction, the cluster reserve, which represents a resource principal in a cluster based network server. We present a design and evaluate a prototype implementation that extends existing techniques for performance isolation on a single node server to cluster based servers.In our design, the dynamic cluster-wide resource management problem is formulated as a constrained optimization problem, with the resource allocations on individual machines as independent variables, and the desired cluster-wide resource allocations as constraints. Periodically collected resource usages serve as further inputs to the problem.Experimental results show that cluster reserves are effective in providing performance isolation in cluster based servers. We demonstrate that, in a number of different scenarios, cluster reserves are effective in ensuring performance isolation while enabling high utilization of the server resources.

REFERENCES

• 1: Daniel Andresen , Tao Yang , Vegard Holmedahl , Oscar H. Ibarra, SWEB: Towards a Scalable World Wide Web Server on Multicomputers, Proceedings of the 10th International Parallel Processing Symposium, p.850-856, April 15-19, 1996
• 2: Apache. http://www.apa~he.org/.
• 3: Martin F. Arlitt , Carey L. Williamson, Web server workload characterization: the search for invariants, Proceedings of the 1996 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, p.126-137, May 23-26, 1996, Philadelphia, Pennsylvania, United States
• 4: M. Aron, P. Druschel, and W. Zwaenepoel. Efficient Support for P-HTTP in Cluster-based Web Servers. In Proceedings of the U~ENIX 1999 Annual Technical Conference, Monterey~ CA, June 1999.
• 5: M. Aron, D. Sanders, P. Druschel, and W. Zwaenepoel. Scalable Content-aware Request Distribution in Cluster-based Network Servers. In Proceedings of the USENIX 2000 Annual Technical Conference, San Diego~ CA~ June 2000.
• 6: Gaurav Banga , Peter Druschel, Measuring the capacity of a Web server under realistic loads, World Wide Web, v.2 n.1-2, p.69-83, 1999
• 7: Gaurav Banga , Peter Druschel , Jeffrey C. Mogul, Resource containers: a new facility for resource management in server systems, Proceedings of the third symposium on Operating systems design and implementation, p.45-58, February 1999, New Orleans, Louisiana, United States
• 8: T. Brisco. DNS Support for Load Balancing. RFC 1794, Apr. 1995.
• 9: J. Bruno, J. Brustoloni, E. Gabber, B. Ozden, and A. Silberschatz. Retrofitting Quality of Service into a Time-Sharing Operating System. In Proceedings of the USENIX 1.999 Annual Technical Conference, Monterey, CA, June 1999.
• 10: J. Bruno, E. Gabber, B. Ozden, and A. Silberschatz. The Eclipse Operating System: Providing Quality of Service via l~eservation Domains. In Proceedings of the USENIX 1998 Annual Technical Conference, Berkeley, CA~ June 1998.
• 11: Cisco Systems Inc. LocalDirector. http://www.cisco.com.
• 12: Om P. Damani , P. Emerald Chung , Yennun Huang , Chandra Kintala , Yi-Min Wang, ONE-IP: techniques for hosting a service on a cluster of machines, Computer Networks and ISDN Systems, v.29 n.8-13, p.1019-1027, Sep. 1997
• 13: Peter Druschel , Gaurav Banga, Lazy receiver processing (LRP): a network subsystem architecture for server systems, Proceedings of the second USENIX symposium on Operating systems design and implementation, p.261-275, October 29-November 01, 1996, Seattle, Washington, United States
• 14: Armando Fox , Steven D. Gribble , Yatin Chawathe , Eric A. Brewer , Paul Gauthier, Cluster-based scalable network services, Proceedings of the sixteenth ACM symposium on Operating systems principles, p.78-91, October 05-08, 1997, Saint Malo, France
• 15: Pawan Goyal , Xingang Guo , Harrick M. Vin, A hierarchial CPU scheduler for multimedia operating systems, Proceedings of the second USENIX symposium on Operating systems design and implementation, p.107-121, October 29-November 01, 1996, Seattle, Washington, United States
• 16: IBM Corporation. IBM interactive network dispatcher. http://www.ics.raleigh.ibm.com/ics/isslearn.htm.
• 17: M. B. Jones , P. J. Leach , R. P. Draves , J. S. ,. Iii Barrera, Modular real-time resource management in the Rialto operating system, Proceedings of the Fifth Workshop on Hot Topics in Operating Systems (HotOS-V), p.12, May 04-05, 1995
• 18: Jeffrey C. Mogul, The case for persistent-connection HTTP, Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication, p.299-313, August 28-September 01, 1995, Cambridge, Massachusetts, United States
• 19: Jason Nieh , Monica S. Lam, The design, implementation and evaluation of SMART: a scheduler for multimedia applications, Proceedings of the sixteenth ACM symposium on Operating systems principles, p.184-197, October 05-08, 1997, Saint Malo, France
• 20: Vivek S. Pai , Mohit Aron , Gaurov Banga , Michael Svendsen , Peter Druschel , Willy Zwaenepoel , Erich Nahum, Locality-aware request distribution in cluster-based network servers, Proceedings of the eighth international conference on Architectural support for programming languages and operating systems, p.205-216, October 02-07, 1998, San Jose, California, United States
• 21: Resonate inc. Resonate dispatch. http://www.resonateinc.com.
• 22: Jay Sethuraman , Mark S. Squillante, Optimal stochastic scheduling in multiclass parallel queues, Proceedings of the 1999 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, p.93-102, May 01-04, 1999, Atlanta, Georgia, United States
• 23: Oliver Spatscheck , Larry L. Peterson, Defending against denial of service attacks in Scout, Proceedings of the third symposium on Operating systems design and implementation, p.59-72, February 1999, New Orleans, Louisiana, United States
• 24: R. Vanderbei. LOQO: An interior point code for quadratic programming. Optimization Methods and Software, 1999.
• 25: Ben Verghese , Anoop Gupta , Mendel Rosenblum, Performance isolation: sharing and isolation in shared-memory multiprocessors, Proceedings of the eighth international conference on Architectural support for programming languages and operating systems, p.181-192, October 02-07, 1998, San Jose, California, United States
• 26: C. A. Waldspurger and W. E. Weihl. Lottery Scheduling: Flexible Proportional-Share Resource Management. In Proceedings of the Ist USENIX Symposium on Operating Systems Design and Implementation, Monterey, CA, Nov. 1994.
• 27: C. Yoshikawa, B. Chun, P. Easthaxn, A. Vahdat, T. Anderson, and D. Culler. Using Smart Clients to Build Scalable Services. In Proceedings of the 1997 USENIX Technical Conference~ Berkeley, CA, Jan. 1997.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.3 Network Operations
          Subjects: Network management
  C.5 COMPUTER SYSTEM IMPLEMENTATION

  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.2 Installation Management
          Subjects: Performance and usage measurement

General Terms:
Design, Management, Measurement, Performance, Theory