research-article

Open access

Non-volatile Storage: Implications of the Datacenter’s Shifting Center

Authors:

Mihir Nanavati,

Malte Schwarzkopf,

Andrew WarfieldAuthors Info & Claims

Queue, Volume 13, Issue 9

Pages 33 - 56

https://doi.org/10.1145/2857274.2874238

Published: 07 November 2015 Publication History

All formats PDF

Abstract

For the entire careers of most practicing computer scientists, a fundamental observation has consistently held true: CPUs are significantly more performant and more expensive than I/O devices. The fact that CPUs can process data at extremely high rates, while simultaneously servicing multiple I/O devices, has had a sweeping impact on the design of both hardware and software for systems of all sizes, for pretty much as long as we’ve been building them.

References

[1]

Belay, A., Prekas, G., Klimovic, A., Grossman, S., Kozyrakis, C., Bugnion, E. 2014. IX: A protected dataplane operating system for high throughput and low latency. In Proceedings of the 11th USENIX Symposium

Digital Library

[2]

Bjørling, M., Axboe, J., Nellans, D., Bonnet, P. 2013, Linux block IO: introducing multi-queue SSD access on multi-core systems. In Proceedings of the 6th International Systems and Storage Conference (SYSTOR).

Digital Library

[3]

Bryant R. E., O'Hallaron, D. R. 2003. Computer systems: a programmer's perspective, volume 2. Prentice Hall, Englewood Cliffs, NJ

[4]

Chen. Y. 2015 The truth about MapReduce performance on SSDs. http://radar.oreilly.com/2015/07/the-truth-aboutmapreduce-performance-on-ssds.html

[5]

Cully, B., Wires, J., Meyer, D., Jamieson, K., Fraser, K., Deegan, T., Stodden, D., Lefebvre, G., Ferstay, D., Warfield, A. 2014. Strata: scalable high-performance storage on virtualized non-volatile memory. In Proceedings of the 12th USENIX conference on File and Storage Technologies (FAST).

Digital Library

[6]

Dean, J. 2007. "Software engineering advice from building large-scale distributed systems." CS295 Lecture at Stanford University, July 2007. http://research.google.com/people/jeff/stanford-295-talk.pdf

[7]

Dean, J., Ghemawat, S. 2004. MapReduce: simplified data processing on large clusters. In Proceedings of the Sixth Symposium on Operating Systems Design and Implementation (OSDI).

Digital Library

[8]

Jeong, E. Y., Woo, S., Jamshed, M., Jeong, H., Ihm, S., Han, D., Park, K. 2014. mTCP: A highly scalable user-level TCP stack for multicore systems. In Proceedings of the 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI).

Digital Library

[9]

Ongaro, D., Rumble, S. M., Stutsman, R., Ousterhout, J., Rosenblum, M. 2011. Fast crash recovery in RAMCloud. In Proceedings of the Twenty-third ACM Symposium on Operating Systems Principles (SOSP).

Digital Library

[10]

Papathanasiou, A. E., Scott. M. L. 2005. Aggressive prefetching: an idea whose time has come. In Proceedings of the 10th USENIX Workshop on Hot Topics in Operating Systems (HotOS).

Digital Library

[11]

Rasmussen, A., Porter, G., Conley, M., Madhyastha, H. V., Mysore, R. N., Pucher, A., Vahdat, A. 2011. TritonSort: a balanced large-scale sorting system. In Proceedings of the 8th USENIX Symposium on Networked Systems Design and Implementation (NSDI).

Digital Library

[12]

Rizzo, L. 1997. A very fast algorithm for RAM compression. ACM SIGOPS Operating Systems Review 31 (2), 36-45.

Digital Library

[13]

Rizzo, L. 2012. Netmap: a novel framework for fast packet I/O. In Proceedings of the USENIX Annual Technical Conference (ATC).

Digital Library

[14]

Tkachenko, V. 2012. Intel SSD 910 vs. HDD RAID in TPC-C-MySQL benchmark. https://www.percona.com/ blog/2012/09/11/intel-ssd-910-vs-hdd-raid-in-tpcc-mysqlbenchmark/

[15]

Wires, J., Ingram, S., Drudi, Z., Harvey, N. J. A., Warfield, A. 2014. Characterizing storage workloads with counter stacks. In Proceedings of the 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI).

Digital Library

[16]

Yang, J., Minturn, D. B., Hady, F. 2012. When poll is better than interrupt. In Proceedings of the 10th USENIX Conference on File and Storage Technologies (FAST).

Digital Library

[17]

Zaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J., McCauley, M., Franklin, M. J., Shenker, S., Stoica, I. 2012. Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing. In Proceedings of the 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI).

Digital Library

Cited By

Trivedi AJansen MDoekemeijer KTalluri STehrany N(2024) Reviving Storage Systems Education in the 21 st Century — An experience report 2024 IEEE 24th International Symposium on Cluster, Cloud and Internet Computing (CCGrid)10.1109/CCGrid59990.2024.00074(616-625)Online publication date: 6-May-2024
https://doi.org/10.1109/CCGrid59990.2024.00074
Gootzen PPfefferle JStoica RTrivedi AGilad YKostic DMoatti YBiran O(2023)DPFS: DPU-Powered File System VirtualizationProceedings of the 16th ACM International Conference on Systems and Storage10.1145/3579370.3594769(1-7)Online publication date: 5-Jun-2023
https://dl.acm.org/doi/10.1145/3579370.3594769
Kim JLim KJung YLee SMin CNoh SDan TDahlia M(2019)Alleviating garbage collection interference through spatial separation in all flash arraysProceedings of the 2019 USENIX Conference on Usenix Annual Technical Conference10.5555/3358807.3358875(799-812)Online publication date: 10-Jul-2019
https://dl.acm.org/doi/10.5555/3358807.3358875
Show More Cited By

Non-volatile Storage: Implications of the Datacenter’s Shifting Center
1. General and reference
  1. Cross-computing tools and techniques

Recommendations

Exposing non-volatile memory cache for adaptive storage access
SAC '15: Proceedings of the 30th Annual ACM Symposium on Applied Computing

This paper proposes a method that combines next generation non-volatile (NV) memory technologies to block storage and makes use of NV memory as storage cache. The existing method to combine cache storage with block storage hides the cache storage under ...
Future Non-volatile Memory Storage Architecture and File System Interface
CANDAR '13: Proceedings of the 2013 First International Symposium on Computing and Networking

Non-volatile memory (NVM) storage is becoming more popular as its performance and cost efficiency improve. Since the performance and characteristics of NVM storage are significantly different from those of HDDs, there are ongoing researches to utilize ...
A file system bypassing volatile main memory: towards a single-level persistent store
CF '18: Proceedings of the 15th ACM International Conference on Computing Frontiers

Existing persistent memory (PM) based file systems rely on a DRAM and PM hybrid store. Although a hybrid store does boost system performance while avoiding some current PM limitations like limited endurance, we envision that with more advances PM ...

Comments

Information & Contributors

Information

Published In

cover image Queue

Queue Volume 13, Issue 9

Structured Data

November-December 2015

156 pages

ISSN:1542-7730

EISSN:1542-7749

DOI:10.1145/2857274

Issue’s Table of Contents

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 November 2015

Published in QUEUE Volume 13, Issue 9

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Popular
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
167,881
Total Downloads

Downloads (Last 12 months)3,209
Downloads (Last 6 weeks)340

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Trivedi AJansen MDoekemeijer KTalluri STehrany N(2024) Reviving Storage Systems Education in the 21 st Century — An experience report 2024 IEEE 24th International Symposium on Cluster, Cloud and Internet Computing (CCGrid)10.1109/CCGrid59990.2024.00074(616-625)Online publication date: 6-May-2024
https://doi.org/10.1109/CCGrid59990.2024.00074
Gootzen PPfefferle JStoica RTrivedi AGilad YKostic DMoatti YBiran O(2023)DPFS: DPU-Powered File System VirtualizationProceedings of the 16th ACM International Conference on Systems and Storage10.1145/3579370.3594769(1-7)Online publication date: 5-Jun-2023
https://dl.acm.org/doi/10.1145/3579370.3594769
Kim JLim KJung YLee SMin CNoh SDan TDahlia M(2019)Alleviating garbage collection interference through spatial separation in all flash arraysProceedings of the 2019 USENIX Conference on Usenix Annual Technical Conference10.5555/3358807.3358875(799-812)Online publication date: 10-Jul-2019
https://dl.acm.org/doi/10.5555/3358807.3358875
Kelly T(2019)Persistent Memory Programming on Conventional HardwareQueue10.1145/3358955.335895717:4(1-20)Online publication date: 1-Aug-2019
https://dl.acm.org/doi/10.1145/3358955.3358957
Ruty GRougier JSurcouf AAugustin A(2019)An initial evaluation of 6Stor, a dynamically scalable IPv6-centric distributed object storage systemCluster Computing10.1007/s10586-018-02897-8Online publication date: 5-Jan-2019
https://doi.org/10.1007/s10586-018-02897-8
Fevgas AAkritidis LBozanis PManolopoulos Y(2019)Indexing in flash storage devices: a survey on challenges, current approaches, and future trendsThe VLDB Journal10.1007/s00778-019-00559-8Online publication date: 3-Aug-2019
https://doi.org/10.1007/s00778-019-00559-8
Mishra PSomani A(2017)Host managed contention avoidance storage solutions for Big DataJournal of Big Data10.1186/s40537-017-0080-94:1Online publication date: 19-Jun-2017
https://doi.org/10.1186/s40537-017-0080-9
Trivedi AIoannou NMetzler BStuedi PPfefferle JKoltsidas IKourtis KGross TChen DDesnoyers Pde Lara E(2017)FlashNetProceedings of the 10th ACM International Systems and Storage Conference10.1145/3078468.3078477(1-14)Online publication date: 22-May-2017
https://dl.acm.org/doi/10.1145/3078468.3078477
Arulraj JPavlo AChirkova RYang JSuciu D(2017)How to Build a Non-Volatile Memory Database Management SystemProceedings of the 2017 ACM International Conference on Management of Data10.1145/3035918.3054780(1753-1758)Online publication date: 9-May-2017
https://dl.acm.org/doi/10.1145/3035918.3054780

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Magazine Site

View this article on the magazine site (external)

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Figures

Tables

Media

View Issue’s Table of Contents