article

Hibernator: helping disk arrays sleep through the winter

Authors:

Kimberly Keeton,

John WilkesAuthors Info & Claims

ACM SIGOPS Operating Systems Review, Volume 39, Issue 5

Pages 177 - 190

https://doi.org/10.1145/1095809.1095828

Published: 20 October 2005 Publication History

Abstract

Energy consumption has become an important issue in high-end data centers, and disk arrays are one of the largest energy consumers within them. Although several attempts have been made to improve disk array energy management, the existing solutions either provide little energy savings or significantly degrade performance for data center workloads.Our solution, Hibernator, is a disk array energy management system that provides improved energy savings while meeting performance goals. Hibernator combines a number of techniques to achieve this: the use of disks that can spin at different speeds, a coarse-grained approach for dynamically deciding which disks should spin at which speeds, efficient ways to migrate the right data to an appropriate-speed disk automatically, and automatic performance boosts if there is a risk that performance goals might not be met due to disk energy management.In this paper, we describe the Hibernator design, and present evaluations of it using both trace-driven simulations and a hybrid system comprised of a real database server (IBM DB2) and an emulated storage server with multi-speed disks. Our file-system and on-line transaction processing (OLTP) simulation results show that Hibernator can provide up to 65% energy savings while continuing to satisfy performance goals (6.5--26 times better than previous solutions). Our OLTP emulated system results show that Hibernator can save more energy (29%) than previous solutions, while still providing an OLTP transaction rate comparable to a RAID5 array with no energy management.

References

[1]

ILOG CPLEX 7.0 documentation home page. http://www.ise.ufl.edu/ilog/cplex70/.

[2]

Panel computer hard disk drive precautions. http://www.pro-face.com/support/technical/00apr3.htm.

[3]

Symmetrix 3000 and 5000 Enterprise Storage Systems product description guide. http://www.emc.com/, 1999.

[4]

Dell PowerEdge 6650 executive summary. http://www.tpc.org/results/individual_results/Dell/dell_6650_010603_es.pdf, Mar. 2003.

[5]

HP announces "smart" cooling solution for data centers. http://www.hp.com/hpinfo/newsroom/press/2003/030304b.html, March 4 2003.

[6]

HP Integrity RX5670 Cluster 64P Executive Summary. http://www.tpc.org/results/individual_results/HP/HP20Integrity20rx5670\20Cluster\2064P_ES.pdf, Dec. 2003.

[7]

D. H. Albonesi. Selective cache ways: on-demand cache resource allocation. In Proc. of the 32nd Annual International Symposium on Microarchitecture, 1999.

Digital Library

[8]

American Power Convension. Determining total cost of ownership for date centers and network room infrastructure. ftp://www.apcmedia.com/salestools/CMRP-5T9PQG_R2_EN.pdf, 2003.

[9]

E. Anderson, M. Hobbs, K. Keeton, S. Spence, M. Uysal, and A. Veitch. Hippodrome: running circles around storage administration. In Proc. of the First USENIX Conference on File and Storage Technologies, Jan. 2002.

Digital Library

[10]

E. Carrera, E. Pinheiro, and R. Bianchini. Conserving disk energy in network servers. In Proc. of the 17th International Conference on Supercomputing, June 2003.

Digital Library

[11]

J. Chase and R. Doyle. Balance of power: energy management for server clusters. In Proc. of the 8th Workshop on Hot Topics in Operating Systems(HotOS), May 2001.

Digital Library

[12]

P. Chen, E. Lee, G. Gibson, R. Katz, and D. Patterson. RAID: high-performance, reliable secondary storage. ACM Computing Surveys, 26(2):145--185, 1994.

Digital Library

[13]

Y. Chen, A. Das, W. Qin, A. Sivasubramaniam, Q. Wang, and N. Gautam. Managing server energy and operational costs in hosting centers. In Proc. of the International Conference on Measurement and Modeling of Computer Systems, June 2005.

Digital Library

[14]

D. Colarelli and D. Grunwald. Massive arrays of idle disks for storage archives. In Proceedings of the 2002 ACM/IEEE Conference on Supercomputing, pages 1--11, June 2002.

Digital Library

[15]

F. Douglis, P. Krishnan, and B. Bershad. Adaptive disk spindown policies for mobile computers. In Proc. of the 2nd USENIX Symposium on Mobile and Location Independent Computing, Apr. 1995.

Digital Library

[16]

G. Ganger, B. Worthington, and Y. Patt. The DiskSim simulation environment - version 2.0 reference manual. http://www.pdl.cmu.edu/DiskSim/disksim2.0.html.

[17]

C. Gniady, Y. C. Hu, and Y.-H. Lu. Program counter based techniques for dynamic power management. In Proc. of the 10th International Symposium on High Performance Computer Architecture, 2004.

Digital Library

[18]

R. Golding, P. Bosch, C. Staelin, T. Sullivan, and J. Wilkes. Idleness is not sloth. In Proc. of the USENIX Winter Technical Conference, Jan. 1995.

Digital Library

[19]

S. Gurumurthi, A. Sivasubramaniam, M. Kandemir, and H. Franke. DRPM: dynamic speed control for power management in server class disks. In Proc. of the 30th International Symposium on Computer Architecture, June 2003.

Digital Library

[20]

D. P. Helmbold, D. D. E. Long, T. L. Sconyers, and B. Sherrod. Adaptive disk spin-down for mobile computers. Mobile Networks and Applications, 5(4):285--297, 2000.

Digital Library

[21]

Ultrastar 36Z15 D atasheet. http://www.hitachigst.com/hdd/ultra/ul36z15.htm, Jan. 2003.

[22]

D. Li, P. Gu, H. Cai, and J. Wang. EERAID: energy-efficient redundant and inexpensive disk array. The 11th ACM SIGOPS European Workshop, Sept. 2004.

Digital Library

[23]

X. Li, Z. Li, F. David, P. Zhou, Y. Zhou, S. Adve, and S. Kumar. Performance directed energy management for main memory and disks. In Proc. of the 11th International Conference on Architectural Support for Programming Languages and Operating Systems, Oct. 2004.

Digital Library

[24]

C. Lumb, J. Schindler, G. Ganger, D. Nagle, and E. Riedel. Towards higher disk head utilization: Extracting "free" bandwidth from busy disk drives. In Proc. of the Fourth USENIX Symposium on Operating Systems Design and Implementation, Oct. 2000.

Digital Library

[25]

G. Magklis, M. L. Scott, G. Semeraro, D. H. Albonesi, and S. Dropsho. Profile-based dynamic voltage and frequency scaling for a multiple clock domain microprocessor. ACM SIGARCH Computer Architecture News, 31(2):14--27, 2003.

Digital Library

[26]

A. Merchant and P. S. Yu. Analytic modeling and comparisons of striping strategies for replicated disk arrays. IEEE Transactions on Computers, 44(3):419--33, 1995.

Digital Library

[27]

B. Moore. Take the data center power and cooling challenge. Energy User News, August 27 2002.

[28]

F. Moore. More power needed. Energy User News, 2002.

[29]

K. Okada, N. Kojima, and K. Yamashita. A novel drive architecture of HDD : multimode hard disc drive. In Proc. of the International Conference on Consumer Electronics, 2000.

[30]

A. E. Papathanasiou and M. L. Scott. Energy efficient prefetching and caching. In Proc. of the USENIX Annual Technical Conference, June 2004.

Digital Library

[31]

D. Patterson, G. Gibson, and R. Katz. A case for redundant arrays of inexpensive disks (RAID). In Proc. of the ACM International Conference on Management of Data, 1988.

Digital Library

[32]

E. Pinheiro and R. Bianchini. Energy conservation techniques for disk array-based servers. In Proc. of the 18th International Conference on Supercomputing, June 2004.

Digital Library

[33]

P. Ranganathan. The power management challenge: Getting the next 100x. Keynote presentation at the 2nd workshop on optimizations for DSPs and Embedded Systems, March 12 2004.

[34]

C. Ruemmler and J. Wilkes. UNIX disk access patterns. In Proc. of the USENIX Winter Technical Conference, 1993.

[35]

S. Savage and J. Wilkes. AFRAID -- a frequently redundant array of independent disks. In USENIX Annual Technical Conference, pages 27--39, 1996.

Digital Library

[36]

E. Shriver, A. Merchant, and J. Wilkes. An analytic behavior model for disk drives with readahead caches and request reordering. In Proc. of the International Conference on Measurement and Modeling of Computer Systems, 1998.

Digital Library

[37]

S. W. Son, G. Chen, and M. Kandemir. Disk layout optimization for reducing energy consumption. In Proc. of the 19th International Conference on Supercomputing, June 2005.

Digital Library

[38]

G. Weikum, P. Zabback, and P. Scheuermann. Dynamic file allocation in disk arrays. In Proc. of the ACM International Conference on Management of Data, 1991.

Digital Library

[39]

A. Weissel, B. Beutel, and F. Bellosa. Cooperative I/O: a novel I/O semantics for energy-aware applications. In Proc. of the Fifth USENIX Symposium on Operating Systems Design and Implementation, Dec. 2002.

Digital Library

[40]

J. Wilkes, R. A. Golding, C. Staelin, and T. Sullivan. The HP AutoRAID hierarchical storage system. ACM Transactions on Computer Systems, 14(1):108--136, 1996.

Digital Library

[41]

E. Wusterenhoff. Service level agreement in the data center. http://www.sun.com/blueprints/0402/sla.pdf, Apr. 2002.

[42]

H. Yada, H. Ishioka, T. Yamakoshi, Y. Onuki, Y. Shimano, M. Uchida, H. Kanno, and N. Hayashi. Head positioning servo and data channel for HDD s with multiple spindle speeds. IEEE Transactions on Magnetics, 36(5):2213--2215, Sept. 2000.

[43]

Y. Zhou, A. Bilas, S. Jagannathan, C. Dubnicki, J. F. Philbin, and K. Li. Experiences with VI communication for database storage. In Proceedings of the 29th Annual International Symposium on Computer Architecture, pages 257--268, May 2002.

Digital Library

[44]

Q. Zhu and Y. Zhou. Power aware storage cache management. IEEE Transactions on Computers, 54(5):587--602, May 2005.

Digital Library

Cited By

Dipta DGulmezoglu B(2022)DF-SCA: Dynamic Frequency Side Channel Attacks are PracticalProceedings of the 38th Annual Computer Security Applications Conference10.1145/3564625.3567979(841-853)Online publication date: 5-Dec-2022
https://dl.acm.org/doi/10.1145/3564625.3567979
Machida FHasebe KAbe HKato K(2022)Analysis of Optimal File Placement for Energy-Efficient File-Sharing Cloud Storage SystemIEEE Transactions on Sustainable Computing10.1109/TSUSC.2020.30372607:1(75-86)Online publication date: 1-Jan-2022
https://doi.org/10.1109/TSUSC.2020.3037260
Choeng HHasebe KAbe HKato K(2020)Multi-tier Power-Saving Method in Cloud Storage Systems for Content Sharing ServicesEconomics of Grids, Clouds, Systems, and Services10.1007/978-3-030-63058-4_13(142-154)Online publication date: 5-Dec-2020
https://doi.org/10.1007/978-3-030-63058-4_13
Show More Cited By

Index Terms

Hibernator: helping disk arrays sleep through the winter
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems

Recommendations

Hibernator: helping disk arrays sleep through the winter
SOSP '05: Proceedings of the twentieth ACM symposium on Operating systems principles

Energy consumption has become an important issue in high-end data centers, and disk arrays are one of the largest energy consumers within them. Although several attempts have been made to improve disk array energy management, the existing solutions ...
File system performance and transaction support
Higher reliability redundant disk arrays: Organization, operation, and coding

Parity is a popular form of data protection in redundant arrays of inexpensive/independent disks (RAID). RAID5 dedicates one out of N disks to parity to mask single disk failures, that is, the contents of a block on a failed disk can be reconstructed by ...

Comments

Information & Contributors

Information

Published In

cover image ACM SIGOPS Operating Systems Review

ACM SIGOPS Operating Systems Review Volume 39, Issue 5

SOSP '05

December 2005

290 pages

ISSN:0163-5980

DOI:10.1145/1095809

Issue’s Table of Contents

SOSP '05: Proceedings of the twentieth ACM symposium on Operating systems principles
October 2005
259 pages
ISBN:1595930795
DOI:10.1145/1095810
General Chair:
Andrew Herbert
Microsoft Research, UK
,
Program Chair:
Ken Birman
Cornell University, USA

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 October 2005

Published in SIGOPS Volume 39, Issue 5

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

287
Total Citations
View Citations
1,406
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Dipta DGulmezoglu B(2022)DF-SCA: Dynamic Frequency Side Channel Attacks are PracticalProceedings of the 38th Annual Computer Security Applications Conference10.1145/3564625.3567979(841-853)Online publication date: 5-Dec-2022
https://dl.acm.org/doi/10.1145/3564625.3567979
Machida FHasebe KAbe HKato K(2022)Analysis of Optimal File Placement for Energy-Efficient File-Sharing Cloud Storage SystemIEEE Transactions on Sustainable Computing10.1109/TSUSC.2020.30372607:1(75-86)Online publication date: 1-Jan-2022
https://doi.org/10.1109/TSUSC.2020.3037260
Choeng HHasebe KAbe HKato K(2020)Multi-tier Power-Saving Method in Cloud Storage Systems for Content Sharing ServicesEconomics of Grids, Clouds, Systems, and Services10.1007/978-3-030-63058-4_13(142-154)Online publication date: 5-Dec-2020
https://doi.org/10.1007/978-3-030-63058-4_13
Chi MLiu JYang J(2019)ColdStore: A Storage System for Archival DataWireless Personal Communications10.1007/s11277-019-06989-5Online publication date: 11-Dec-2019
https://doi.org/10.1007/s11277-019-06989-5
Liu JZhang JLi JLiu L(2019)A High-Performance Storage System Based with Dual RAID EngineSmart Computing and Communication10.1007/978-3-030-34139-8_6(53-62)Online publication date: 11-Oct-2019
https://dl.acm.org/doi/10.1007/978-3-030-34139-8_6
Tay Y(2018)Analytical Performance Modeling for Computer Systems, Third EditionSynthesis Lectures on Computer Science10.2200/S00859ED3V01Y201806CSL0107:1(1-171)Online publication date: 23-Jul-2018
https://doi.org/10.2200/S00859ED3V01Y201806CSL010
Sun ZZhang QLi YTan Y(2018)DPPDLIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2016.260504528:1(193-205)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1109/TCSVT.2016.2605045
Song M(2018)Minimizing Power Consumption in Video Servers by the Combined Use of Solid-State Disks and Multi-Speed DisksIEEE Access10.1109/ACCESS.2018.28322216(25737-25746)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2832221
Yu XTan YSun ZLiu JLiang CZhang Q(2018)A fault-tolerant and energy-efficient continuous data protection systemJournal of Ambient Intelligence and Humanized Computing10.1007/s12652-018-0726-2Online publication date: 9-Mar-2018
https://doi.org/10.1007/s12652-018-0726-2
Machado VBraga ARampon NBez JBoito FKassick RPadoin EDiaz JMéhaut JNavaux PShin SShin DLencastre M(2017)Towards energy-efficient storage serversProceedings of the Symposium on Applied Computing10.1145/3019612.3019742(1554-1559)Online publication date: 3-Apr-2017
https://dl.acm.org/doi/10.1145/3019612.3019742
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents