poster

Orthrus: a framework for implementing high-performance collective I/O in the multicore clusters

Authors:

Xuechen Zhang,

Jianqiang Ou,

Kei Davis,

Song JiangAuthors Info & Claims

HPDC '13: Proceedings of the 22nd international symposium on High-performance parallel and distributed computing

Pages 113 - 114

https://doi.org/10.1145/2493123.2462924

Published: 17 June 2013 Publication History

Get Access

Abstract

This paper presents a framework, Orthrus, that can accommodate multiple collective-I/O implementations, each optimized for some performance aspects, and dynamically select the best performing one accordingly to current workload and system performance bottleneck. We have implemented Orthrus in the ROMIO library. Our experimental results with representative MPI-IO benchmarks show that Orthrus can significantly improve the performance of collective I/O under various workloads and system scenarios.

References

[1]

"FT: Discrete 3D Fast Fourier Transform", URL: http://www.nas.nasa.gov/publications/npb.html

Google Scholar

[2]

R. Thakur, W. Gropp, and E. Lusk, "Data Sieving and Collective I/O in ROMIO", In Frontiers'99.

Digital Library

Google Scholar

[3]

X. Zhang, S. Jiang, and K. Davis, "Making Resonance a Common Case: A High-Performance Implementation of Collective I/O on Parallel File Systems", In IPDPS'09.

Digital Library

Google Scholar

Index Terms

Orthrus: a framework for implementing high-performance collective I/O in the multicore clusters
1. Computer systems organization
  1. Architectures
    1. Parallel architectures
      1. Interconnection architectures
2. Hardware
  1. Integrated circuits
    1. Interconnect

Recommendations

Orthrus: a framework for implementing high-performance collective I/O in the multicore clusters
HPDC '13: Proceedings of the 22nd international symposium on High-performance parallel and distributed computing

This paper presents a framework, Orthrus, that can accommodate multiple collective-I/O implementations, each optimized for some performance aspects, and dynamically select the best performing one accordingly to current workload and system performance ...
Taming parallel I/O complexity with auto-tuning
SC '13: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis

We present an auto-tuning system for optimizing I/O performance of HDF5 applications and demonstrate its value across platforms, applications, and at scale. The system uses a genetic algorithm to search a large space of tunable parameters and to ...
A framework for auto-tuning HDF5 applications
HPDC '13: Proceedings of the 22nd international symposium on High-performance parallel and distributed computing

The modern parallel I/O stack consists of several software layers with complex inter-dependencies and performance characteristics. While each layer exposes tunable parameters, it is often unclear to users how different parameter settings interact with ...

Comments

Information & Contributors

Information

Published In

HPDC '13: Proceedings of the 22nd international symposium on High-performance parallel and distributed computing

June 2013

276 pages

ISBN:9781450319102

DOI:10.1145/2493123

General Chairs:
Manish Parashar
Rutgers University, USA
,
Jon Weissman
University of Minnesota, USA
,
Program Chairs:
Dick Epema
Delft University of Technology and Eindhoven University of Technology, The Netherlands
,
Renato Figueiredo
University of Florida, USA and Vrije Universiteit, The Netherlands

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 June 2013

Check for updates

Author Tags

Qualifiers

Poster

Conference

HPDC'13

Sponsor:

University of Arizona
SIGARCH

HPDC'13: The 22nd International Symposium on High-Performance Parallel and Distributed Computing

June 17 - 21, 2013

New York, New York, USA

Acceptance Rates

HPDC '13 Paper Acceptance Rate 20 of 131 submissions, 15%;

Overall Acceptance Rate 166 of 966 submissions, 17%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

0
Total Citations
140
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Index Terms

Recommendations