vGreen: A System for Energy-Efficient Management of Virtual Machines

Abstract

In this article, we present vGreen, a multitiered software system for energy-efficient virtual machine management in a clustered virtualized environment. The system leverages the use of novel hierarchical metrics that work across the different abstractions in a virtualized environment to capture power and performance characteristics of both the virtual and physical machines. These characteristics are then used to implement policies for scheduling and power management of virtual machines across the cluster. We show through real implementation of the system on a state-of-the-art testbed of server machines that vGreen improves both average performance and system-level energy savings by close to 40% across benchmarks with varying characteristics.

References

1. Abdelsalam, H. S., Maly, K., Mukkamala, R., Zubair, M., and Kaminsky, D. 2009. Analysis of energy efficiency in clouds. In Future Computing, Service Computation, Cognitive, Adaptive, Content, Patterns, Computation World, 416--421.
2. Amazon. 2008. Amazon Elastic Compute Cloud (Amazon EC2). http://aws.amazon.com/ec2/.
3. Ayoub, R., Sherifi, S., and Rosing, T. 2010. Gentlecool: Cooling aware proactive workload scheduling in multi-machine systems. In Proceedings of the IEEE Design, Automation Test in Europe (DATE’10).
4. Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., and Warfield, A. 2003. Xen and the art of virtualization. In Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP’03). ACM, New York, 164--177.
5. Bobroff, N., Kochut, A., and Beaty, K. 2007. Dynamic placement of virtual machines for managing sla violations. In Integrated Network Management. IEEE, 119--128.
6. Chase, J. S., Anderson, D. C., Thakar, P. N., Vahdat, A. M., and Doyle, R.P. 2001. Managing energy and server resources in hosting centers. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP’01). ACM, New York, 103--116.
7. Clark, C., Fraser, K., Hand, S., Hansen, J. G., Jul, E., Limpach, C., Pratt, I., and Warfield, A. 2005. Live migration of virtual machines. In Proceedings of the 2nd Conference on Symposium on Networked Systems Design & Implementation (NSDI’’05). USENIX Association, 273--286.
8. Dhiman, G., Marchetti, G., and Rosing, T. 2009. vGreen: A system for energy efficient computing in virtualized environments. In Proceedings of the International Symposium on Lower Power Electronics and Design (ISLPED’09). ACM, New York.
9. Dhiman, G., Mihic, K., and Rosing, T. 2010. A system for online power prediction in virtualized environments using gaussian mixture models. In Proceedings of the 47th Design Automation Conference (DAC’10). ACM, New York, 807--812.
10. Dhiman, G., Pusukuri, K., and Rosing, T. S. 2008. Analysis of dynamic voltage scaling for system level energy management. In Proceedings of the Workshop on Power Aware Computing and Systems (HotPower’08).
11. Dhiman, G. and Rosing, T. S. 2007. Dynamic voltage frequency scaling for multi-tasking systems using online learning. In Proceedings of the International Symposium on Low Power Electronics and Design (ISLPED’07). ACM, New York, 207--212.
12. Fan, X., Weber, W.-D., and Barroso, L. A. 2007. Power provisioning for a warehouse-sized computer. In Proceedings of the 34th Annual International Symposium on Computer Architecture (ISCA’07). ACM, New York, 13--23.
13. Ge, R., Feng, X., Feng, W.-C., and Cameron, K. W. 2007. Cpu miser: A performance-directed, run-time system for power-aware clusters. In Proceedings of the International Conference on Parallel Processing (ICPP’07). IEEE Computer Society, 18.
14. Haletky, E. L. 2008. VMware ESX Server in the Enterprise: Planning and Securing Virtualization Servers. Prentice Hall.
15. Hermenier, F., Lorca, X., Menaud, J.-M., Muller, G., and Lawall, J. 2009. Entropy: a consolidation manager for clusters. In Proceedings of the ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE’09). ACM, New York, 41--50.
16. IPMI. 2004. Intelligent platform management interface v2.0 specification. http://www.intel.com/design/servers/impi.
17. Isci, C., Contreras, G., and Martonosi, M. 2006. Live, runtime phase monitoring and prediction on real systems with application to dynamic power management. In Proceedings of the 39th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO’39). IEEE Computer Society, 359--370.
18. Kansal, A., Zhao, F., Liu, J., Kothari, N., and Bhattacharya, A. A. 2010. Virtual machine power metering and provisioning. In Proceedings of the 1st ACM Symposium on Cloud Computing (SoCC’10). ACM, New York, 39--50.
19. Knauerhase, R. C., Brett, P., Hohlt, B., Li, T., and Hahn, S. 2008. Using os observations to improve performance in multicore systems. IEEE Micro 28, 3, 54--66.
20. Koller, R., Verma, A., and Neogi, A. 2010. Wattapp: An application aware power meter for shared data centers. In Proceeding of the 7th International Conference on Autonomic Computing (ICAC’10). ACM, New York, 31--40.
21. Liu, L., Wang, H., Liu, X., Jin, X., He, W. B., Wang, Q. B., and Chen, Y. 2009. Greencloud: a new architecture for green data center. In Proceedings of the 6th International Conference Industry Session on Autonomic Computing and Communications Industry Session (ICAC-INDST’09). ACM, New York, 29--38.
22. McNett, M., Gupta, D., Vahdat, A., and Voelker, G. M. 2007. Usher: An extensible framework for managing custers of virtual machines. In Proceedings of the 21st Conference on Large Installation System Administration Conference (LISA’07). USENIX Association, 1--15.
23. Meisner, D., Gold, B., and Thomas, W. 2009. Powernap: Eliminating server idle power. In Proceedings of the 14th International Conference on Architectural Support for Programming Languages and Operating Systems.
24. Merkel, A. and Bellosa, F. 2006. Balancing power consumption in multiprocessor systems. SIGOPS Oper. Syst. Rev. 40, 4, 403--414.
25. Merkel, A., Stoess, J., and Bellosa, F. 2010. Resource-conscious scheduling for energy efficiency on multicore processors. In Proceedings of the 5th European Conference on Computer Systems (EuroSys’10). ACM, New York, 153--166.
26. Moore, J., Chase, J., Ranganathan, P., and Sharma, R. 2005. Making scheduling “cool”: Temperature-aware workload placement in data centers. In Proceedings of the Annual Conference on USENIX Annual Technical Conference (ATEC’05). USENIX Association, 5--5.
27. Nathuji, R., England, P., Sharma, P., and Singh, A. 2009. Feedback driven qos-aware power budgeting for virtualized servers. In Proceedings of the 4th International Workshop on Feedback Control Implementation and Design in Computing Systems and Networks (FeBID’09).
28. Nathuji, R., Kansal, A., and Ghaffarkhah, A. 2010. Q-clouds: Managing performance interference effects for qos-aware clouds. In Proceedings of the 5th European Conference on Computer Systems (EuroSys’10). ACM, New York, 237--250.
29. Nathuji, R. and Schwan, K. 2007. Virtualpower: Coordinated power management in virtualized enterprise systems. In Proceedings of 21st ACM SIGOPS Symposium on Operating Systems Principles (SOSP’07). ACM, New York, 265--278.
30. Nurmi, D., Wolski, R., Grzegorczyk, C., Obertelli, G., Soman, S., Youseff, L., and Zagorodnov, D. 2008. The eucalyptus open-source cloud-computing system. In Proceedings of Cloud Computing and Its Applications.
31. OpenNebula. Opennebula homepage. http://dev.opennebula.org/
32. Pakbaznia, E. and Pedram, M. 2009. Minimizing data center cooling and server power costs. In Proceedings of the International Symposium on Lower Power Electronics and Design (ISLPED’09). ACM, 145--150.
33. Raghavendra, R., Ranganathan, P., Talwar, V., Wang, Z., and Zhu, X. 2008. No “power” struggles: Coordinated multi-level power management for the data center. In Proceedings of the 13th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS’08). ACM, New York, 48--59.
34. Ranganathan, P., Leech, P., Irwin, D., and Chase, J. 2006. Ensemble-level power management for dense blade servers. In Proceedings of the 33rd Annual International Symposium on Computer Architecture (ISCA’06). IEEE Computer Society, 66--77.
35. Snavely, A. and Tullsen, D. M. 2000. Symbiotic jobscheduling for a simultaneous mutlithreading processor. SIGPLAN Not. 35, 11, 234--244.
36. Stoess, J., Lang, C., and Bellosa, F. 2007. Energy management for hypervisor-based virtual machines. In Proceedings of the USENIX Annual Technical Conference (ATC’07). USENIX Association, 1--14.
37. Verma, A., Ahuja, P., and Neogi, A. 2008. Power-Aware dynamic placement of hpc applications. In Proceedings of the 22nd Annual International Conference on supercomputing (ICS’08). ACM, New York, 175--184.
38. VMware. 2009. Vmware distributed resource scheduler. http://www.vmware.com/products/drs/
39. Wang, L., von Laszewski, G., Tao, J., and Kunze, M. 2009. Grid virtualization engine: design, implementation and evaluation. IEEE Syst. J. 3, 4, 477--488.
40. Wang, R. and Kandasamy, N. 2009. A distributed control framework for performance management of virtualized computing environments: Some preliminary results. In Proceedings of the 1st Workshop on Automated Control for Datacenters and Clouds (ACDC’09). ACM, New York, 7--12.
41. Wood, T., Shenoy, P., and Arun. 2007. Black-Box and gray-box strategies for virtual machine migration. In Proceedings of the ACM Symposium on Networked Systems Design and Implementation (NSDI’07). 229--242.

Index Terms

• Software and its engineering

  • Software creation and management

    • Designing software

  • Software organization and properties

    • Contextual software domains

      • Operating systems