research-article

Strawman: A Batch In Situ Visualization and Analysis Infrastructure for Multi-Physics Simulation Codes

Authors:

Matthew Larsen,

Cyrus HarrisonAuthors Info & Claims

ISAV2015: Proceedings of the First Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization

Pages 30 - 35

https://doi.org/10.1145/2828612.2828625

Published: 15 November 2015 Publication History

Abstract

We present Strawman, a system designed to explore the in situ visualization and analysis needs of simulation code teams planning for multi-physics calculations on exascale architectures. Strawman's design derives from key requirements from a diverse set of simulation code teams, including lightweight usage of shared resources, batch processing, ability to leverage modern architectures, and ease-of-use both for software integration and for usage during simulation runs. We describe the Strawman system, the key technologies it depends on, and our experiences integrating Strawman into three proxy simulations. Our findings show that Strawman's design meets our target requirements, and that some of its concepts may be worthy of integration into our community in situ implementations.

References

[1]

Apache thrift. https://thrift.apache.org/. {Accessed 12-Aug-2015}.

[2]

Bson specification. http://bsonspec.org/. {Accessed 12-Aug-2015}.

[3]

Civetweb project. https://github.com/civetweb/civetweb. {Accessed 16-Aug-2015}.

[4]

CloverLeaf3D. http://uk-mac.github.io/CloverLeaf3D/. {Accessed 14-Aug-2015}.

[5]

Conduit documentation. http://scalability-llnl.github.io/conduit/. {Accessed 14-Aug-2015}.

[6]

Hydrodynamics Challenge Problem, Lawrence Livermore National Laboratory. Technical Report LLNL-TR-490254.

[7]

Json specification. http://json.org/. {Accessed 12-Aug-2015}.

[8]

Kripke. https://codesign.llnl.gov/kripke.php. {Accessed 14-Aug-2015}.

[9]

MFEM: Modular finite element methods. http://www.mfem.org. {Accessed 16-Aug-2015}.

[10]

Protocol buffers. https://developers.google.com/protocol-buffers/. {Accessed 12-Aug-2015}.

[11]

Silo. https://silo.llnl.gov. {Accessed 16-Aug-2015}.

[12]

XDMF: extensible data model and format. http://www.xdmf.org. {Accessed 16-Aug-2015}.

[13]

G. E. Blelloch. Vector Models for Data-Parallel Computing. MIT Press, 1990.

Digital Library

[14]

M. Dorier, G. Antoniu, F. Cappello, M. Snir, and L. Orf. Damaris: How to efficiently leverage multicore parallelism to achieve scalable, jitter-free i/o. In Cluster Computing (CLUSTER), 2012 IEEE International Conference on, pages 155--163. IEEE, 2012.

Digital Library

[15]

N. Fabian, K. Moreland, D. Thompson, A. C. Bauer, P. Marion, B. Geveci, M. Rasquin, and K. E. Jan. The paraview coprocessing library: A scalable, general purpose in situ visualization library. In Large Data Analysis and Visualization (LDAV), 2011 IEEE Symposium on, pages 89--96. IEEE, 2011.

[16]

I. Karlin, J. Keasler, and R. Neely. Lulesh 2.0 updates and changes. Technical Report LLNL-TR-641973, Aug 2013.

[17]

A. Kunen. Kripke: User manual v1.0. Technical report, Aug 2014.

[18]

M. Larsen, S. Labasan, P. Navrátil, J. Meredith, and H. Childs. Volume Rendering Via Data-Parallel Primitives. In Proceedings of EuroGraphics Symposium on Parallel Graphics and Visualization (EGPGV), pages 53--62, Cagliari, Italy, May 2015.

Digital Library

[19]

M. Larsen, J. Meredith, P. Navrátil, and H. Childs. Ray-Tracing Within a Data Parallel Framework. In Proceedings of the IEEE Pacific Visualization Symposium, pages 279--286, Hangzhou, China, Apr. 2015.

[20]

L.-t. Lo, C. Sewell, and J. Ahrens. PISTON: A portable cross-platform framework for data-parallel visualization operators. pages 11--20. Eurographics Symposium on Parallel Graphics and Visualization, 2012.

[21]

J. F. Lofstead, S. Klasky, K. Schwan, N. Podhorszki, and C. Jin. Flexible io and integration for scientific codes through the adaptable io system (adios). In Proceedings of the 6th international workshop on Challenges of large applications in distributed environments, pages 15--24. ACM, 2008.

Digital Library

[22]

B. Lorendeau, Y. Fournier, and A. Ribes. In-situ visualization in fluid mechanics using catalyst: A case study for code saturne. In Large-Scale Data Analysis and Visualization (LDAV), 2013 IEEE Symposium on, pages 53--57. IEEE, 2013.

[23]

A. Mallinson, D. A. Beckingsale, W. Gaudin, J. Herdman, J. Levesque, and S. A. Jarvis. Cloverleaf: Preparing hydrodynamics codes for exascale. 2013.

[24]

J. S. Meredith, S. Ahern, D. Pugmire, and R. Sisneros. EAVL: The extreme-scale analysis and visualization library. In H. Childs, T. Kuhlen, and F. Marton, editors, Eurographics Symposium on Parallel Graphics and Visualization. The Eurographics Association, 2012.

[25]

K. Moreland. Icet users guide and reference. Technical report, version 2.0. Technical Report SAND2010-7451, Sandia National Laboratories, 2011.

[26]

K. Moreland, U. Ayachit, B. Geveci, and K.-L. Ma. Dax Toolkit: A Proposed Framework for Data Analysis and Visualization at Extreme Scale. In Proceedings of the IEEE Symposium on Large-Scale Data Analysis and Visualization, pages 97--104, Oct 2011.

[27]

K. Moreland, W. Kendall, T. Peterka, and J. Huang. An image compositing solution at scale. In Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis, page 25. ACM, 2011.

Digital Library

[28]

K. Moreland, B. Wylie, and C. Pavlakos. Sort-last parallel rendering for viewing extremely large data sets on tile displays. In Parallel and Large-Data Visualization and Graphics, 2001. Proceedings. IEEE 2001 Symposium on, pages 85--154, Oct 2001.

Digital Library

[29]

W. J. Schroeder, K. M. Martin, and W. E. Lorensen. The Design and Implementation of an Object-Oriented Toolkit for 3D Graphics and Visualization. In VIS '96: Proceedings of the 7th Conference on Visualization '96, pages 93--100. IEEE Computer Society Press, 1996.

Digital Library

[30]

S. v. d. Walt, S. C. Colbert, and G. Varoquaux. The numpy array: A structure for efficient numerical computation. Computing in Science & Engineering, 13(2):22--30, 2011.

Digital Library

[31]

B. Whitlock, J. Favre, and J. Meredith. Parallel in situ coupling of simulation with a fully featured visualization system. 2011.

Cited By

Heroux MAhrens JArienti MAyachit UBennett JBinyahib RBiswas ABremer PBrugger EBujack RCarr HChen JChilds HDutta SEssiari AGeveci BHarrison CHazarika SFulp MHristov PHuang XInsley JKawakami YKeilers CKress JLarsen MLipsa DMajumder MMarsaglia NMateevitsi VPascucci VPatchett JPatel SPetruzza SPugmire DRizzi SRogers DRübel OSalinas JSane SShudler SStewart ATsai KTurton TUsher WWang ZWeber GWetterer-Nelson CWoodring JYenpure A(2025)The ECP ALPINE projectInternational Journal of High Performance Computing Applications10.1177/1094342024128652139:1(32-51)Online publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1177/10943420241286521
Harrison CLarsen MRyujin BKunen ACapps APrivitera J(2022)Conduit: A Successful Strategy for Describing and Sharing Data In Situ2022 IEEE/ACM International Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV)10.1109/ISAV56555.2022.00006(1-6)Online publication date: Nov-2022
https://doi.org/10.1109/ISAV56555.2022.00006
Aparecida Silva Camacho TMartins do Rosario VOliveira Napoli OBorin E(2022) PB 3 Opt: Profile‐based biased Bayesian optimization to select computing clusters on the cloud Concurrency and Computation: Practice and Experience10.1002/cpe.754035:18Online publication date: 22-Dec-2022
https://doi.org/10.1002/cpe.7540
Show More Cited By

Index Terms

Strawman: A Batch In Situ Visualization and Analysis Infrastructure for Multi-Physics Simulation Codes

Recommendations

Strawman: resolving collisions in bursty low-power wireless networks
IPSN '12: Proceedings of the 11th international conference on Information Processing in Sensor Networks

Low-power wireless networks must leverage radio duty cycling to reduce energy consumption, but duty cycling drastically increases the risk of radio collisions, resulting in power-expensive retransmissions or data loss. We present Strawman, a contention ...
StrawMAN: making sudden traffic surges graceful in low-power wireless networks
HotEmNets '10: Proceedings of the 6th Workshop on Hot Topics in Embedded Networked Sensors

To ensure a long lifetime, sensor networks must operate with a low duty cycle, but the duty cycle must be high enough for the network to handle expected peak traffic loads. Being dimensioned for peak traffic rather than regular traffic leads to shorter ...
Generic Support for PKIX Certificate Management in CDSA
ACSAC '99: Proceedings of the 15th Annual Computer Security Applications Conference

The Common Data Security Architecture (CDSA) from the Open Group is a flexible standard that defines APIs for security services needed for implementing Public Key Infrastructure (PKI). The emerging IETF Public Key Infrastructure (PKIX) standards provide ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ISAV2015: Proceedings of the First Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization

November 2015

51 pages

ISBN:9781450340038

DOI:10.1145/2828612

Publications Chair:
Gunther H. Weber
Lawrence Berkeley National Laboratory, USA

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 November 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Research
Refereed limited

Conference

SC15

Sponsor:

SC15: The International Conference for High Performance Computing, Networking, Storage and Analysis

November 15 - 20, 2015

TX, Austin, USA

Acceptance Rates

ISAV2015 Paper Acceptance Rate 8 of 19 submissions, 42%;

Overall Acceptance Rate 23 of 63 submissions, 37%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

28
Total Citations
View Citations
178
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Heroux MAhrens JArienti MAyachit UBennett JBinyahib RBiswas ABremer PBrugger EBujack RCarr HChen JChilds HDutta SEssiari AGeveci BHarrison CHazarika SFulp MHristov PHuang XInsley JKawakami YKeilers CKress JLarsen MLipsa DMajumder MMarsaglia NMateevitsi VPascucci VPatchett JPatel SPetruzza SPugmire DRizzi SRogers DRübel OSalinas JSane SShudler SStewart ATsai KTurton TUsher WWang ZWeber GWetterer-Nelson CWoodring JYenpure A(2025)The ECP ALPINE projectInternational Journal of High Performance Computing Applications10.1177/1094342024128652139:1(32-51)Online publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1177/10943420241286521
Harrison CLarsen MRyujin BKunen ACapps APrivitera J(2022)Conduit: A Successful Strategy for Describing and Sharing Data In Situ2022 IEEE/ACM International Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV)10.1109/ISAV56555.2022.00006(1-6)Online publication date: Nov-2022
https://doi.org/10.1109/ISAV56555.2022.00006
Aparecida Silva Camacho TMartins do Rosario VOliveira Napoli OBorin E(2022) PB 3 Opt: Profile‐based biased Bayesian optimization to select computing clusters on the cloud Concurrency and Computation: Practice and Experience10.1002/cpe.754035:18Online publication date: 22-Dec-2022
https://doi.org/10.1002/cpe.7540
Wang ZSubedi PDorier MDavis PParashar M(2021)Facilitating Staging-based Unstructured Mesh Processing to Support Hybrid In-Situ Workflows2021 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)10.1109/IPDPSW52791.2021.00152(960-964)Online publication date: Jun-2021
https://doi.org/10.1109/IPDPSW52791.2021.00152
Abram GAdhinarayanan VFeng WRogers DAhrens J(2020)ETH: An Architecture for Exploring the Design Space of In-situ Scientific Visualization2020 IEEE International Parallel and Distributed Processing Symposium (IPDPS)10.1109/IPDPS47924.2020.00060(515-526)Online publication date: May-2020
https://doi.org/10.1109/IPDPS47924.2020.00060
Medeiros TPereira LRossi FLuizelli MBeck ALorenzon A(2019)Transparent Aging-Aware Thread Throttling2019 31st International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD)10.1109/SBAC-PAD.2019.00014(1-8)Online publication date: Oct-2019
https://doi.org/10.1109/SBAC-PAD.2019.00014
Labasan SLarsen MChilds HRountree B(2019)Power and Performance Tradeoffs for Visualization Algorithms2019 IEEE International Parallel and Distributed Processing Symposium (IPDPS)10.1109/IPDPS.2019.00042(325-334)Online publication date: May-2019
https://doi.org/10.1109/IPDPS.2019.00042
Warren RSoumagne JMu JTang HByna SDong BKoziol Q(2019)Analysis in the Data Path of an Object-Centric Data Management System2019 IEEE 26th International Conference on High Performance Computing, Data, and Analytics (HiPC)10.1109/HiPC.2019.00020(73-82)Online publication date: Dec-2019
https://doi.org/10.1109/HiPC.2019.00020
Wood CLarsen MGimenez AHuck KHarrison CGamblin TMalony A(2019)Projecting Performance Data over Simulation Geometry Using SOSflow and ALPINEChildhood, Science Fiction, and Pedagogy10.1007/978-3-030-17872-7_12(201-218)Online publication date: 24-Apr-2019
https://doi.org/10.1007/978-3-030-17872-7_12
Usher WRizzi SWald IAmstutz JInsley JVishwanath VFerrier NPapka MPascucci VWolf MMoreland KBethel E(2018)libISProceedings of the Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization10.1145/3281464.3281466(33-38)Online publication date: 11-Nov-2018
https://dl.acm.org/doi/10.1145/3281464.3281466
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten