Durability of replicated distributed storage systems

ABSTRACT

We study the problem of guaranteeing data durability [2] in distributed storage systems based on replication. Our work is motivated by several several recent efforts [3, 5, 1] to build such systems in a peer-to-peer environment. The key features of this environment which make achieving durability difficult are (1) data lifetimes may be several orders of magnitude larger than the lifetimes of individual storage units, and (2) the system may have little or no control over the participation of these storage units in the system. We use a model-based approach to develop engineering principles for designing automated replication and repair mechanisms to implement durability in such systems.

REFERENCES

• 1: Adya, A., Bolosky, W., Castro, M., Cermak, G., Chaiken, R., Douceur, J., Howell, J., Lorch, J., Theimer, M., and Wattenhofer, R. Farsite: Federated, available, and reliable storage for an incompletely trusted environment. In Proceedings of USENIX OSDI (2002).
• 2: Chun, B., Dabek, F., Haeberlen, A., Sit, E., Weatherspoon, H., Kaashoek, F., Kubiatowicz, J., and Morris, R. Efficient replica maintenance for distributed storage systems. In Proceedings of USENIX NSDI (2006).
• 3: Dabek, F., Kaashoek, F., Karger, D., Morris, R., and Stoica, I. Wide-area cooperative storage with cfs. In Proceedings of ACM SOSP (2001).
• 4: Ramabhadran, S., and Pasquale, J. Analysis of the durability of replicated distributed storage systems. UCSD Technical Report CS2007-0900 (2007).
• 5: Rowstron, A., and Druschel, P. Storage management and caching in past, a large-scale, persistent peer-to-peer storage utility. In Proceedings of ACM SOSP (2001).

INDEX TERMS

Primary Classification:
  D. Software
  D.4 OPERATING SYSTEMS
      D.4.3 File Systems Management
          Subjects: Distributed file systems

Additional Classification:
  E. Data
  E.5 FILES
      Subjects: Backup/recovery

General Terms:
Design, Performance, Reliability

Keywords:
durability, replication