Optimizing virtual machine live storage migration in heterogeneous storage environment

ABSTRACT

Virtual machine (VM) live storage migration techniques significantly increase the mobility and manageability of virtual machines in the era of cloud computing. On the other hand, as solid state drives (SSDs) become increasingly popular in data centers, VM live storage migration will inevitably encounter heterogeneous storage environments. Nevertheless, conventional migration mechanisms do not consider the speed discrepancy and SSD's wear-out issue, which not only causes significant performance degradation but also shortens SSD's lifetime. This paper, for the first time, addresses the efficiency of VM live storage migration in heterogeneous storage environments from a multi-dimensional perspective, i.e., user experience, device wearing, and manageability. We derive a flexible metric (migration cost), which captures various design preference. Based on that, we propose and prototype three new storage migration strategies, namely: 1) Low Redundancy (LR), which generates the least amount of redundant writes; 2) Source-based Low Redundancy (SLR), which keeps the balance between IO performance and write redundancy; and 3) Asynchronous IO Mirroring, which seeks the highest IO performance. The evaluation of our prototyped system shows that our techniques outperform existing live storage migration by a significant margin. Furthermore, by adaptively mixing our proposed schemes, the cost of massive VM live storage migration can be even lower than that of only using the best of individual mechanism.

References

1. "Amazon EC2", http://aws.amazon.com/ec2/
2. "Microsoft Azure", http://www.windowsazure.com/en-us/
3. "Flash Drives Replace Disks at Amazon, Facebook, Dropbox", http://www.wired.com/wiredenterprise/2012/06/flash-data-centers/
4. "Morphlabs, Dell DCS Team on SSD-Powered Cloud", http://www.datacenterknowledge.com/archives/2012/03/28/morphlabs-dell-dcs-team-on-ssd-powered-cloud/
5. "SolidFire Develops All-SSD System for Cloud Storage Providers", http://searchstoragechannel.techtarget.com/news/2240037093/SolidFire-develops-all-SSD-system-for-cloud-storage-providers
6. "Intel Takes Their SSD Reliability to the Datacenter", http://www.zdnet.com/blog/datacenter/intel-takes-their-ssd-reliability-to-the-datacenter/1316
7. Gokul Soundararajan, Vijayan Prabhakaran, et al., Extending SSD Lifetimes with Disk-Based Write Caches, FAST 2010
8. EMC, http://www.us.emc.com/index.htm
9. Winchester Systems, http://www.winsys.com
10. Ali Mashtizadeh, et al., The Design and Evolution of Live Storage Migration in VMware ESX, ATC 2011
11. Robert Bradford, Evangelos Kotsovinos, Anja Feldmann, Harald Schioberg, Live Wide-Area Migration of Virtual Machines Including Local Persistent State, VEE 2007
12. Yingwei Luo, Binbin Zhang, et al., Live and Incremental Whole-System Migration of Virtual Machines Using Block-Bitmap, ICCC 2008
13. Jie Zheng, T. S. Eugene Ng, Kunwadee Sripanidkulchai, Workload-Aware Live Storage Migration for Clouds, VEE 2011
14. Takahiro Hirofuchi, et al., A Live Storage Migration Mechanism over WAN for Relocatable Virtual Machine Services on Clouds, CCGRID 2009
15. XEN Project http://www.xen.org, January 2009
16. Iometer Project, http://www.iometer.org
17. Dbench, http://dbench.samba.org
18. IOzone File System Benchmark, http://www.iozone.org
19. Aameek Singh, Madhukar Korupolu, et al., Server-Storage Virtualization: Integration and Load Balancing in Data Centers, SC 2008
20. Seonyeong Park, A Comprehensive Study of Energy Efficiency and Performance of Flash-based SSD, Journal of Systems Architecture, 2011
21. Guanying Wu and Xubin He, FTL: Improving SSD Lifetime via Exploiting Content Locality, EuroSys 2012
22. Youngjae Kim, et al., HybridStore: A Cost-Efficient, High-Performance Storage System Combining SSDs and HDDs, MASCOTS 2011
23. Heeseung Jo, Youngjin Kwon, Hwanju Kim, Euiseong Seo, Joonwon Lee, and Seungryoul Maeng, SSD-HDD-Hybrid Virtual Disk in Consolidated Environments, VHPC 2009
24. Feng Chen, David Koufaty, Xiaodong Zhang, Hystor: Making the Best Use of Solid State Drives in High Performance Storage Systems, ICS 2011
25. William K. Josephson, et al., DFS: A File System for Virtualized Flash Storage, ACM Transactions on Storage, Sept 2010
26. Bob Laliberte, Delivering Greater Effectiveness and Efficiency for SANs in Virtualized Data Centers. White Paper, EMC
27. Intel Launches DC S3700 SSD for Data Centers, http://hothardware.com/News/Intel-Launches-New-Datacenter-SSDs-Emphasizes-Data-Protection-High-Performance/

Index Terms

• Computer systems organization

  • Dependable and fault-tolerant systems and networks

• General and reference

  • Cross-computing tools and techniques

    • Performance

• Networks

  • Network performance evaluation

• Software and its engineering

  • Software organization and properties

    • Extra-functional properties

      • Software performance