ABSTRACT
The emerging open cloud computing model will provide users with great freedom to dynamically migrate virtualized computing services to, from, and between clouds over the wide-area. While this freedom leads to many potential benefits, the running services must be minimally disrupted by the migration. Unfortunately, current solutions for wide-area migration incur too much disruption as they will significantly slow down storage I/O operations during migration. The resulting increase in service latency could be very costly to a business. This paper presents a novel storage migration scheduling algorithm that can greatly improve storage I/O performance during wide-area migration. Our algorithm is unique in that it considers individual virtual machine's storage I/O workload such as temporal locality, spatial locality and popularity characteristics to compute an efficient data transfer schedule. Using a fully implemented system on KVM and a trace-driven framework, we show that our algorithm provides large performance benefits across a wide range of popular virtual machine workloads.
- Michael Armbrust, Armando Fox, Rean Griffith, and et. al. Above the clouds: A berkeley view of cloud computing. Technical Report UCB/EECS-2009-28, EECS Department, University of California, Berkeley, Feb 2009.Google Scholar
- M.G. Baker, J.H. Hartman, M.D. Kupfer, K.W. Shirriff, and J.K. Ousterhout. Measurements of a distributed file system. ACM SIGOPS Operating Systems Review, 25(5):212, 1991. Google ScholarDigital Library
- M. Blaze. NFS tracing by passive network monitoring. In Proceedings of the USENIX Winter 1992 Technical Conference, pages 333--343, 1992.Google Scholar
- "Amazon Web Services Blog". Animoto - Scaling Through Viral Growth. http://aws.typepad.com/aws/2008/04/animoto-scali.html, April 2008.Google Scholar
- Robert Bradford, Evangelos Kotsovinos, Anja Feldmann, and Harald Schioberg. Live wide-area migration of virtual machines including local persistent state. In ACM/Usenix VEE, June 2007. Google ScholarDigital Library
- Christopher Clark, Keir Fraser, Steven Hand, Jacob Gorm Hansen, Eric Jul, Christian Limpach, Ian Pratt, and Andrew Warfield. Live migration of virtual machines. In NSDI'05: Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation, pages 273--286, Berkeley, CA, USA, 2005. USENIX Association. Google ScholarDigital Library
- M.D. Dahlin, C.J. Mather, R.Y. Wang, T.E. Anderson, and D.A. Patterson. A quantitative analysis of cache policies for scalable network file systems. ACM SIGMETRICS Performance Evaluation Review, 22(1):150--160, 1994. Google ScholarDigital Library
- Derek Gottfrid. The New York Times ArchivesGoogle Scholar
- Amazon Web Services = TimesMachine. http://open.blogs.nytimes.com/ 2008/05/21/the-new-york-times-archives-amazon-web-services-timesmachine/, May 2008.Google Scholar
- James Hamilton. The Cost of Latency. http://perspectives.mvdirona.com/2009/10/31/TheCostOfLatency.aspx, October 2009.Google Scholar
- Michael R. Hines and Kartik Gopalan. Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning. In VEE '09: Proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environments, 2009. Google ScholarDigital Library
- Takahiro Hirofuchi, Hidemoto Nakada, Hirotaka Ogawa, Satoshi Itoh, and Satoshi Sekiguchi. A live storage migration mechanism over wan and its performance evaluation. In VIDC'09: Proceedings of the 3rd International Workshop on Virtualization Technologies in Distributed Computing, Barcelona, Spain, 2009. ACM. Google ScholarDigital Library
- Takahiro Hirofuchi, Hirotaka Ogawa, Hidemoto Nakada, Satoshi Itoh, and Satoshi Sekiguchi. A live storage migration mechanism over wan for relocatable virtual machine services on clouds. In CCGRID'09: Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, Shanghai, China, 2009. IEEE Computer Society. Google ScholarDigital Library
- Hai Jin, Li Deng, Song Wu, and Xuanhua Shi. Live virtual machine migration integrating memory compression with precopy. In IEEE International Conference on Cluster Computing, 2009.Google ScholarCross Ref
- KVM. QEMU-KVM code. http://sourceforge.net/projects/kvm/files, January 2010.Google Scholar
- Yingwei Luo, Binbin Zhang, Xiaolin Wang, Zhenlin Wang, Yifeng Sun, and Haogang Chen. Live and Incremental Whole-System Migration of Virtual Machines Using Block-Bitmap. In IEEE International Conference on Cluster Computing, 2008.Google Scholar
- Open Cloud Manifesto. Open Cloud Manifesto. http://www.opencloudmanifesto.org/, January 2010.Google Scholar
- Michael Nelson, Beng-Hong Lim, and Greg Hutchins. Fast transparent migration for virtual machines. In USENIX'05: Proceedings of the 2005 Usenix Annual Technical Conference, Berkeley, CA, USA, 2005. USENIX Association. Google ScholarDigital Library
- J.K. Ousterhout, H. Da Costa, D. Harrison, J.A. Kunze, M. Kupfer, and J.G. Thompson. A trace-driven analysis of the UNIX 4.2 BSD file system. ACM SIGOPS Operating Systems Review, 19(5):24, 1985. Google ScholarDigital Library
- K.K. Ramakrishnan, Prashant Shenoy, and Jacobus Van der Merwe. Live data center migration across wans: A robust cooperative context aware approach. In ACM SIGCOMM Workshop on Internet Network Management (INM), Kyoto, Japan, Aug 2007. Google ScholarDigital Library
- IBM Redbooks. IBM Powervm Live Partition Mobility IBM International Technical Support Organization. Vervante, 2009. Google ScholarDigital Library
- D. Roselli, J.R. Lorch, and T.E. Anderson. A comparison of file system workloads. In Proceedings of the annual conference on USENIX Annual Technical Conference, page 4. USENIX Association, 2000. Google ScholarDigital Library
- Franco Travostino, Paul Daspit, Leon Gommans, Chetan Jog, Cees de Laat, Joe Mambretti, Inder Monga, Bas van Oudenaarde, Satish Raghunath, and Phil Yonghui Wang. Seamless live migration of virtual machines over the man/wan. Future Gener. Comput. Syst., 22(8):901--907, 2006. Google ScholarDigital Library
- VMWare. VMmark Virtualization Benchmarks. http://www.vmware.com/products/vmmark/, January 2010.Google Scholar
- Timothy Wood, Prashant Shenoy, Alexandre Gerber, K.K. Ramakrishnan, and Jacobus Van der Merwe. The Case for Enterprise-Ready Virtual Private Clouds. In Proc. of HotCloud Workshop, 2009. Google ScholarDigital Library
- Timothy Wood, Prashant Shenoy, Arun Venkataramani, and Mazin Yousif. Black-box and gray-box strategies for virtual machine migration. In NSDI, 2007. Google ScholarDigital Library
- XEN. XEN Project. http://www.xen.org, January 2009.Google Scholar
Index Terms
Workload-aware live storage migration for clouds
Recommendations
A live storage migration mechanism over wan and its performance evaluation
VTDC '09: Proceedings of the 3rd international workshop on Virtualization technologies in distributed computingLive migration of virtual machines is a key technology for the next generation of IaaS cloud services, contributing to dynamic portability and mobility of VM-based services among datacenters. The practical use of live migration, however, is still ...
Workload-aware live storage migration for clouds
VEE '11The emerging open cloud computing model will provide users with great freedom to dynamically migrate virtualized computing services to, from, and between clouds over the wide-area. While this freedom leads to many potential benefits, the running ...
Performance Analysis for Pareto-Optimal Green Consolidation Based on Virtual Machines Live Migration
Huge energy requirement of cloud data centers is prime concern. Dynamic Virtual Machine VM consolidation based on VM live migration to switched-off or put some of the under-loaded host Physical Machines PMs into a low power consumption mode can ...
Comments