Ganesha Shanmuganathan
ABSTRACT
Current public cloud offerings sell capacity in the form of pre-defined virtual machine (VM) configurations to their tenants. Typically this means that tenants must purchase individual VM configurations based on the peak demands of the applications, or be restricted to only scale-out applications that can share a pool of VMs. This diminishes the value proposition of moving to a public cloud as compared to server consolidation in a private virtualized datacenter, where one gets the benefits of statistical multiplexing between VMs belonging to the same or different applications. Ideally one would like to enable a cloud tenant to buy capacity in bulk and benefit from statistical multiplexing among its workloads. This requires the purchased capacity to be dynamically and transparently allocated among the tenant's VMs that may be running on different servers, even across datacenters. In this paper, we propose two novel algorithms called BPX and DBS that are able to provide the cloud customer with the abstraction of buying bulk capacity. These algorithms dynamically allocate the bulk capacity purchased by a customer between its VMs based on their individual demands and user-set importance. Our algorithms are highly scalable and are designed to work in a large-scale distributed environment. We implemented a prototype of BPX as part of VMware's management software and showed that BPX is able to closely mimic the behavior of a centralized allocator in a distributed manner.
- Linux containers (LXC) overview document. http://lxc.sourceforge.net/lxc.html.Google Scholar
- Solaris Resource Management. http://docs.sun.com/app/docs/doc/817-1592.Google Scholar
- B. Agrawal, L. Spracklen, S. Satnur, and R.Bidarkar. Vmware view 5.0 performance and best practices. 2011. http://www.vmware.com/files/pdf/view/VMware-View-Performance-Study-Best-Practices-Technical-White-Paper.pdf.Google Scholar
- D. Ardagna, M. Trubian, and L. Zhang. SLA based resource allocation policies in autonomic environments.J. Parallel Distrib. Comput., 67(3):259--270, 2007. Google ScholarDigital Library
- G. Banga, P. Druschel, and J. C. Mogul. Resource containers: a new facility for resource management in server systems. In OSDI '99. Google ScholarDigital Library
- G. Casale, N. Mi, L. Cherkasova, and E. Smirni. How to parameterize models with bursty workloads. SIGMETRICS Perform. Eval. Rev., 36(2):38--44, 2008. Google ScholarDigital Library
- L. Cherkasova and J. A. Rolia. R-opus: A composite framework for application performability and qos in shared resource pools. In DSN, pages 526--535, 2006. Google ScholarDigital Library
- D. Gmach, J. Rolia, and L. Cherkasova. Satisfying service level objectices in a self-managing resource pool. In SASO, 2009. Google ScholarDigital Library
- D. Gmach, J. Rolia, and L. Cherkasova. Selling t-shirts and time shares in the cloud. In CCGRID, pages 539--546, 2012. Google ScholarDigital Library
- D. Gmach, J. Rolia, L. Cherkasova, G. Belrose, T. Turicchi, and A. Kemper. An integrated approach to resource pool management: Policies, efficiency and quality metrics. In DSN, pages 326--335, 2008.Google ScholarCross Ref
- D. Gmach, J. Rolia, L. Cherkasova, and A. Kemper. Capacity management and demand prediction for next generation data centers. In ICWS, pages 43--50, 2007.Google ScholarCross Ref
- A. Gulati, A. Holler, M. Ji, G. Shanmuganathan, C. Waldspurger, and X. Zhu. VMware Distributed Resource Management: Design, Implementation, and Lessons Learned. In VMware Technical Journal, March 2012.Google Scholar
- B. Hindman, A. Konwinski, M. Zaharia, A. Ghodsi, A. D. Joseph, R. Katz, S. Shenker, and I. Stoica. Mesos: a platform for fine-grained resource sharing in the data center. In Proceedings of the 8th USENIX conference on Networked systems design and implementation, NSDI'11, 2011. Google ScholarDigital Library
- X. Meng, C. Isci, J. O. Kephart, L. Zhang, E. Bouillet, and D. E. Pendarakis. Efficient resource provisioning in compute clouds via vm multiplexing. In ICAC, pages 11--20, 2010. Google ScholarDigital Library
- Microsoft, Inc. Microsoft Hyper-V Server. 2012. http://www.microsoft.com/en-us/server-cloud/hyper-v-server/default.aspx%.Google Scholar
- Nebula, Inc. 2012. http://www.nebula.com/.Google Scholar
- Nimbula, Inc. 2012. http://www.nimbula.com/.Google Scholar
- D. Niu, C. Feng, and B. Li. Pricing cloud bandwidth reservations under demand uncertainty. In SIGMETRICS, pages 151--162, 2012. Google ScholarDigital Library
- L. Spracklen, B. Agrawal, R.Bidarkar, and H. Sivaraman. Comprehensive user experience monitoring. March 2011. VMware Technical Journal.Google Scholar
- C. Stewart and K. Shen. Performance modeling and system management for multi-component online services. In NSDI, 2005. Google ScholarDigital Library
- J. Tan, P. Dube, X. Meng, and L. Zhang. Exploiting resource usage patterns for better utilization prediction. In ICDCS Workshops, pages 14--19, 2011. Google ScholarDigital Library
- Y. Tan, Y. Lu, and C. H. Xia. Provisioning for large scale cloud computing services. In SIGMETRICS, pages 407--408, 2012. Google ScholarDigital Library
- B. Urgaonkar, G. Pacifici, P. J. Shenoy, M. Spreitzer, and A. N. Tantawi. An analytical model for multi-tier internet services and its applications. In SIGMETRICS, pages 291--302, 2005. Google ScholarDigital Library
- B. Urgaonkar, A. L. Rosenberg, and P. J. Shenoy. Application placement on a cluster of servers. Int. J. Found. Comput. Sci., 18(5), 2007.Google ScholarCross Ref
- B. Urgaonkar, P. J. Shenoy, and T. Roscoe. Resource overbooking and application profiling in shared hosting platforms. In OSDI, 2002. Google ScholarDigital Library
- VMware Big Data team. 2012. http://www.vmware.com/hadoop/serengeti.html.Google Scholar
- VMware, Inc. VMware vCloud Suite. 2012. http://www.vmware.com/products/datacenter-virtualization/vcloud-suite/o%verview.html.Google Scholar
- C. A. Waldspurger. Memory Resource Management in VMware ESX Server. In USENIX OSDI '02. Google ScholarDigital Library
- H. Wang, K. Doshi, and P. Varman. Nested QoS: Adaptive burst decomposition for SLO guarantees in virtualized servers. Intel Technology Journal, 16:156--181, June 2012.Google Scholar
- K. Wang, M. Lin, F. Ciucu, A. Wierman, and C. Lin. Characterizing the impact of the workload on the value of dynamic resizing in data centers. In SIGMETRICS, pages 405--406, 2012. Google ScholarDigital Library
- M. Wang, X. Meng, and L. Zhang. Consolidating virtual machines with dynamic bandwidth demand in data centers. In INFOCOM, 2011.Google ScholarCross Ref
- W. Wang, B. Li, and B. Liang. Towards optimal capacity segmentation with hybrid cloud pricing. In ICDCS, pages 425--434, 2012. Google ScholarDigital Library
- T. Wood, L. Cherkasova, K. M. Ozonat, and P. J. Shenoy. Profiling and modeling resource usage of virtualized applications. In Middleware, pages 366--387, 2008. Google ScholarDigital Library
- Q. Zhang, L. Cherkasova, G. Mathews, W. Greene, and E. Smirni. R-capriccio: A capacity planning and anomaly detection tool for enterprise services with live workloads. In Middleware, 2007. Google ScholarDigital Library
Index Terms
- Defragmenting the cloud using demand-based resource allocation
Recommendations
Defragmenting the cloud using demand-based resource allocation
Performance evaluation reviewCurrent public cloud offerings sell capacity in the form of pre-defined virtual machine (VM) configurations to their tenants. Typically this means that tenants must purchase individual VM configurations based on the peak demands of the applications, or ...
Prediction of resource contention in cloud using second order Markov model
AbstractThe performance of applications running on the cloud entirely depends on two factors, namely, network availability and resource management. Resource contention occurs when request for resources to a host exceeds the availability of the resources ...
QoS-Driven Cloud Resource Management through Fuzzy Model Predictive Control
ICAC '15: Proceedings of the 2015 IEEE International Conference on Autonomic ComputingVirtualized systems such as public and private clouds are emerging as important new computing platforms with great potential to conveniently deliver computing across the Internet and efficiently utilize resources consolidated via virtualization. ...
Comments