research-article

Taming the storage dragon: the adventures of hoTMaN

Authors:

Shahram Ghandeharizadeh,

Aber WhitcombAuthors Info & Claims

SIGMOD '09: Proceedings of the 2009 ACM SIGMOD International Conference on Management of data

Pages 925 - 930

https://doi.org/10.1145/1559845.1559949

Published: 29 June 2009 Publication History

Get Access

Abstract

HoTMaN (HoT-standby MaNager) is a joint project between MySpace and USC Database Laboratory to design and develop a tool to ensure a 24x7 up-time and ease administration of Terabytes of storage that sits underneath hundreds of database servers. The HoTMaN tool's innovation and uniqueness is that it can, with a few clicks, perform operational tasks that require hundreds of keyboard strokes by "trusted trained" experts. With HoTMaN, MySpace can within minutes migrate the relational database(s) of a failed server to a hot-standby. A process that could take over 1 hour and had a high potential for human error is now performed reliably. A database internal to HoTMaN captures all virtual disks, volume and file configurations associated with each SQL Server and candidate hot-standby servers where SQL server processing could be migrated. HoTMaN is deployed in production and its current operational benefits include: (i) enhanced availability of data, and (ii) planned maintenance and patching.

References

[1]

M. Creeger. CTO Storage Roundtable, Part Two. Communications of the ACM, 51(9):47--52, 2008.

Digital Library

Google Scholar

[2]

D. DeWitt, S. Ghandeharizadeh, D. Schneider, A. Bricker, H. Hsiao, and R. Rasmussen. The Gamma database machine project. IEEE Transactions on Knowledge and Data Engineering, 1(2), March 1990.

Digital Library

Google Scholar

[3]

S. Ghandeharizadeh and D. DeWitt. Hybrid-Range Partitioning Strategy: A New Declustering Strategy for Multiprocessor Database Machines. In VLDB, Brisbane, Queensland, Australia, August 1990.

Digital Library

Google Scholar

[4]

S. Ghandeharizadeh, S. Gao, C. Gahagan, and R. Krauss. An On-Line Re-Organization Framework for SAN File Systems. In ADBIS, volume 4152 of Lecture Notes in Computer Science, pages 399--414. Springer, 2006.

Digital Library

Google Scholar

[5]

M. Livny, S. Khoshafian, and H. Boral. Multi-Disk Management Algorithms. In Proceedings of the 1987 ACM SIGMETRICS Int'l Conf. on Measurement and Modeling of Computer Systems, May 1987.

Digital Library

Google Scholar

[6]

Nagios. http://www.nagios.org. 2008.

Google Scholar

[7]

M.A. Olson, K. Bostic, and M.I. Seltzer. Berkeley. In USENIX Annual Technical Conference, FREENIX Track, pages 183--191, 1999.

Google Scholar

[8]

M. Stonebraker, S.R. Madden, D.J. Abadi, S. Harizopoulos, N. Hachem, and P. Helland. The End of an Architectural Era (It's Time for a Complete Rewrite). In VLDB, Vienna, Austria, September 2007.

Digital Library

Google Scholar

[9]

A. Wergeles. HoTMaN Discussions on October 17, 2008. Private Communication, 2008.

Google Scholar

Cited By

View all

Ghandeharizadeh SMenon JKotzur GSen SChawla G(2016)Host Side Caching: Solutions and OpportunitiesDatabases and Information Systems10.1007/978-3-319-40180-5_14(196-210)Online publication date: 21-Jun-2016
https://doi.org/10.1007/978-3-319-40180-5_14
Jiang WZhang LLiao XJin HPeng Y(2014)A novel clustered MongoDB-based storage system for unstructured data with high availabilityComputing10.1007/s00607-013-0355-896:6(455-478)Online publication date: 1-Jun-2014
https://dl.acm.org/doi/10.1007/s00607-013-0355-8
Jiang WZhang LQiang WJin HPeng Y(2012)MyStoreProceedings of the 2012 IEEE 14th International Conference on High Performance Computing and Communication & 2012 IEEE 9th International Conference on Embedded Software and Systems10.1109/HPCC.2012.39(233-240)Online publication date: 25-Jun-2012
https://dl.acm.org/doi/10.1109/HPCC.2012.39

Index Terms

Taming the storage dragon: the adventures of hoTMaN
1. Information systems
  1. Data management systems
    1. Database management system engines
      1. Parallel and distributed DBMSs
2. Software and its engineering
  1. Software organization and properties
    1. Extra-functional properties
      1. Software fault tolerance

Recommendations

Storage Efficient and Secure Replicated Distributed Databases

Data availability and security are two important issues in a distributed database system. Existing schemes achieve high availability at the expense of higher storage cost and data security at the expense of higher processing cost. We develop an ...
Towards a more accurate availability evaluation in peer-to-peer storage systems

Data availability evaluation is the crucial problem to build large-scale, high available peer-to-peer storage systems by governing many unreliable hosts. However, many recent studies equate host availability with data availability and calculate data ...
Atomic writes for data integrity and consistency in shared storage devices for clusters
Special issue: Advanced services for clusters and internet computing

With the recent trend to use storage area networks in distributed and cluster systems there is a need to improve the integrity and consistency guarantees of stored data in the presence of node or network failures. Currently, the main method for ...

Comments

Information & Contributors

Information

Published In

SIGMOD '09: Proceedings of the 2009 ACM SIGMOD International Conference on Management of data

June 2009

1168 pages

ISBN:9781605585512

DOI:10.1145/1559845

Editors:
Carsten Binnig,
Benoit Dageville,
General Chairs:
Uğur Çetintemel
Brown University, USA
,
Stan Zdonik
Brown University, USA
,
Program Chair:
Donald Kossmann
ETH Zurich, Switzerland

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 June 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SIGMOD/PODS '09

Sponsor:

SIGMOD/PODS '09: International Conference on Management of Data

June 29 - July 2, 2009

Rhode Island, Providence, USA

Acceptance Rates

Overall Acceptance Rate 785 of 4,003 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
305
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ghandeharizadeh SMenon JKotzur GSen SChawla G(2016)Host Side Caching: Solutions and OpportunitiesDatabases and Information Systems10.1007/978-3-319-40180-5_14(196-210)Online publication date: 21-Jun-2016
https://doi.org/10.1007/978-3-319-40180-5_14
Jiang WZhang LLiao XJin HPeng Y(2014)A novel clustered MongoDB-based storage system for unstructured data with high availabilityComputing10.1007/s00607-013-0355-896:6(455-478)Online publication date: 1-Jun-2014
https://dl.acm.org/doi/10.1007/s00607-013-0355-8
Jiang WZhang LQiang WJin HPeng Y(2012)MyStoreProceedings of the 2012 IEEE 14th International Conference on High Performance Computing and Communication & 2012 IEEE 9th International Conference on Embedded Software and Systems10.1109/HPCC.2012.39(233-240)Online publication date: 25-Jun-2012
https://dl.acm.org/doi/10.1109/HPCC.2012.39

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Storage Efficient and Secure Replicated Distributed Databases

Towards a more accurate availability evaluation in peer-to-peer storage systems

Atomic writes for data integrity and consistency in shared storage devices for clusters

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations