research-article

Free access

Accuracy study and improvement of network simulation in the SimGrid framework

Authors:

Arnaud LegrandAuthors Info & Claims

Simutools '09: Proceedings of the 2nd International Conference on Simulation Tools and Techniques

Article No.: 13, Pages 1 - 10

https://doi.org/10.4108/ICST.SIMUTOOLS2009.5592

Published: 02 March 2009 Publication History

Abstract

Distributed computing is a very broad and active research area comprising fields such as cluster computing, computational grids, desktop grids and peer-to-peer (P2P) systems. Studies in this area generally resort to simulations, which enable reproducible results and make it possible to explore wide ranges of platform and application scenarios. In this context, network simulation is certainly the most critical part. Many packet-level network simulators are available and enable high-accuracy simulation but they lead to prohibitively long simulation times. Therefore, many simulation frameworks have been developed that simulate networks at higher levels, thus enabling fast simulation but losing accuracy. One such framework, SimGrid, uses a flow-level approach that approximates the behavior of TCP networks, including TCP's bandwidth sharing properties. A preliminary study of the accuracy loss by comparing it to popular packet-level simulators has been proposed in [11] and in which regimes in which SimGrid's accuracy is comparable to that of these packet-level simulators are identified. In this article we come back on this study, reproduce these experiments and provide a deeper analysis that enables us to greatly improve SimGrid's range of validity.

References

[1]

U. P. X. D. Al'fag and A. Schiper. Neko: A Single Environment to Simulate and Prototype Distributed Algorithms. Journal of Information Science and Engeneering, 18(6):981--997, 2002.

[2]

D. Bertsekas and R. Gallager. Data Networks. Prentice-Hall, 1992.

Digital Library

[3]

D. G. Cameron, A. P. Millar, C. Nicholson, F. Z. R. Carvajal-Schiaffino, and K. Stockinger. Optorsim: a Simulation Tool for Scheduling and Replica Optimization in Data Grids. In Computing in High Energy and Nuclear Physics (CHEP) conference, September 2004.

[4]

H. Casanova, A. Legrand, and M. Quinson. SimGrid: a Generic Framework for Large-Scale Distributed Experiments. In 10th IEEE International Conference on Computer Modeling and Simulation, Mar. 2008.

Digital Library

[5]

H. Casanova and L. Marchal. A network model for simulation of grid application. Technical Report 2002--40, LIP, 2002.

[6]

D. M. Chiu. Some Observations on Fairness of Bandwidth Sharing. In 10th IEEE Symposium on Computers and Communications (ISCC), July 2000.

Digital Library

[7]

J. H. Cowie, H. liu, J. Liu, D. Nicol, and A. Ogielski. Towards Realistic Million-Node Internet Simulations. In International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA), June 1999.

[8]

J. H. Cowie, D. M. Nicol, and A. Ogielski. Modeling the Global Internet. Computing in Science and Engineering, 1(1):42--50, 1999.

Digital Library

[9]

C. Dumistrescu and I. Foster. GangSim: A Simulator for Grid Scheduling Studies. In Fifth IEEE International Symposium on Cluster Computing and the Grid (CCGrid'05), May 2005.

Digital Library

[10]

S. Floyd and K. Fall. Promoting the Use of End-to-end Congestion Control in the Internet. IEEE/ACM Transactions on Networking, 7(4):458--472, 1999.

Digital Library

[11]

K. Fujiwara and H. Casanova. Speed and accuracy of network simulation in the simgrid framework. In Proceedings of the First International Workshop on Network Simulation Tools (NSTools), 2007.

Digital Library

[12]

B. Liu, D. R. Figueiredo, Y. Guo, J. F. Kurose, and D. F. Towsley. A Study of Networks Simulation Efficiency: Fluid Simulation vs. Packet-level Simulation. In IEEE INFOCOM, April 2001.

[13]

X. Liu and A. Chien. A Traffic-based Load Balance for Scalable Network Emulation. In ACM Conference on High Performance Computing and Networking (SC003), November 2003.

Digital Library

[14]

S. H. Low. A duality model of TCP and queue management algorithms. IEEE/ACM Transactions on Networking, 11(4):525--536, 2003.

Digital Library

[15]

L. Massoulié and J. Roberts. Bandwidth Sharing: Objectives and Algorithms. IEEE/ACM Transactions on Networking, 10(3):320--328, 2002.

Digital Library

[16]

M. Mathis, J. Semke, and J. Mahdavi. The Macroscopic Behavior of the TCP Congestion Avoidance Algorithm. Computer Comunications, 27(3):??, 1997.

Digital Library

[17]

A. Medina, A. Lakhina, I. Matta, and J. Byers. BRITE: Universal topology generation from a user's perspective. Electronic manual, Apr. 2001. Available at http://www.nrg.cs.uoregon.edu/topology_generation/brite-manual/.

[18]

T. Ott, J. Kemperman, and M. Mathis. Window Size Behavior in TCP/IP with Constant Loss Probabillity. In 4th IEEE Workshop on High-Performance Communication Systems, June 1997.

[19]

J. Padhye, V. Firoiu, D. Towsley, and J. Krusoe. Modeling TCP Throughput: A Simple Model and its Empirical Validation. In ACM SIGCOMM, September 1998.

Digital Library

[20]

S. Phatanapherom, V. Kachitvichyanukul, and P. Uthayopas. Fast Simulation Model for Grid Scheduling Using Hypersim. In 2003 Winter Simulation Conference, December 2003.

Digital Library

[21]

B. Quetier and F. Cappello. A Survey of Grid Research Tools: Simulators, Emulators and Real Life Platforms. In 17th IMACS World Congress, July 2005.

[22]

G. F. Riley. The Georgia Tech Network Simulator. In ACM SIGCOMM Workshop on Models, Methods and Tools for Reproducible Network Research, August 2003.

Digital Library

[23]

The SimGrid project. http://simgrid.gforge.inria.fr.

[24]

M. Snir and W. Gropp. MPI: The Complete Reference. MIT Press, second edition, 1998.

Digital Library

[25]

H. J. Song, X. Liu, D. Jackobsen, R. Bhagwan, X. Zhang, K. Taura, and A. Chien. The MicroGrid: a Scientific Tool for Modelling Computational Grids. Scientific Programming, 8(3):127--141, 2000.

Digital Library

[26]

A. Sulistio, G. Poduvaly, R. Buyya, and C.-K. Tham. On Incorporating Differentiated Level of Network Service into GridSim. Future Generation Computer Systems, 23(4):606--615, 2007.

Digital Library

[27]

A. Takefusa, S. Matsuoka, H. Nakada, K. Aida, and U. Nagashima. Overview of a Performance Evaluation System for Global computing Scheduling Algorithms. In 8th IEEE International Symposium on High Performance Distributed Computing (HPDC-8), August 1999.

Digital Library

[28]

N.-. Team. The Network Simulator - NS-2. http://nsnam.isi.edu/nsnam/index.php/User_Information.

[29]

A. Vahdat, K. Yocum, K. Walsh, P. Mahadevan, J. Kostic, D. Chase, and D. Becker. Scalability and Accuracy in a Large-Scale Network Emulator. In 5th ACM/USENIX Symposium on Operating System Design and Implementation (OSDI), December 2002.

Digital Library

[30]

B. M. Waxman. Routing of Multipoint Connections. IEEE Journal on Selected Areas in Communications, 6(9):1617--1622, December 1988.

Digital Library

Cited By

Djigal HFeng JLu J(2019)Task Scheduling for Heterogeneous Computing using a Predict Cost MatrixWorkshop Proceedings of the 48th International Conference on Parallel Processing10.1145/3339186.3339206(1-10)Online publication date: 5-Aug-2019
https://dl.acm.org/doi/10.1145/3339186.3339206
Chai ABazm MCamarasu-Pop SGlatard TBenoit-Cattin HSutern F(2017)Modeling Distributed Platforms from Application Traces for Realistic File Transfer SimulationProceedings of the 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing10.1109/CCGRID.2017.13(54-63)Online publication date: 14-May-2017
https://dl.acm.org/doi/10.1109/CCGRID.2017.13
Zhang WHao MSnir M(2017)Predicting HPC parallel program performance based on LLVM compilerCluster Computing10.1007/s10586-016-0707-120:2(1179-1192)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1007/s10586-016-0707-1
Show More Cited By

Index Terms

Accuracy study and improvement of network simulation in the SimGrid framework
1. Computing methodologies
  1. Modeling and simulation
    1. Model development and analysis
      1. Model verification and validation
    2. Simulation support systems

Recommendations

Speed and accuracy of network simulation in the SimGrid framework
ValueTools '07: Proceedings of the 2nd international conference on Performance evaluation methodologies and tools

The experimental study of distributed systems and algorithms for large-scale internet platforms typically requires simulation of compute and network resources. This paper focuses on network simulation issues. While many packet-level network simulators ...
Unison: A Parallel-Efficient and User-Transparent Network Simulation Kernel
EuroSys '24: Proceedings of the Nineteenth European Conference on Computer Systems

Discrete-event simulation (DES) is a prevalent tool for evaluating network designs. Although DES offers full fidelity and generality, its slow performance limits its application. To speed up DES, many network simulators employ parallel discrete-event ...
Design, Realization and Evaluation of a Component-based, Compositional Network Simulation Environment

In this paper, we present a component-based network simulation environment that provides a systematic way to simulate, with high fidelity, protocol operations in a variety of target network architectures. We take a four-step approach to developing such a ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

Simutools '09: Proceedings of the 2nd International Conference on Simulation Tools and Techniques

March 2009

720 pages

ISBN:9789639799455

General Chairs:
Olivier Dalle
University of Nice Sophia Antipolis, CNRS & INRIA, France
,
Gabriel Wainer
Carleton University, Canada
,
Program Chairs:
L. Felipe Perrone
Bucknell University, Lewisburg, PA
,
Giovanni Stea
University of Pisa, Italy

Sponsors

Create-Net
ICST

Publisher

ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering)

Brussels, Belgium

Publication History

Published: 02 March 2009

Author Tag

network simulation

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
235
Total Downloads

Downloads (Last 12 months)34
Downloads (Last 6 weeks)6

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Djigal HFeng JLu J(2019)Task Scheduling for Heterogeneous Computing using a Predict Cost MatrixWorkshop Proceedings of the 48th International Conference on Parallel Processing10.1145/3339186.3339206(1-10)Online publication date: 5-Aug-2019
https://dl.acm.org/doi/10.1145/3339186.3339206
Chai ABazm MCamarasu-Pop SGlatard TBenoit-Cattin HSutern F(2017)Modeling Distributed Platforms from Application Traces for Realistic File Transfer SimulationProceedings of the 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing10.1109/CCGRID.2017.13(54-63)Online publication date: 14-May-2017
https://dl.acm.org/doi/10.1109/CCGRID.2017.13
Zhang WHao MSnir M(2017)Predicting HPC parallel program performance based on LLVM compilerCluster Computing10.1007/s10586-016-0707-120:2(1179-1192)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1007/s10586-016-0707-1
Pfennig SFeldhoff KCiorba FFranz EReiher TBielert MIlsche TNagel WWeinbub JBaboulin MThacker WPolok L(2016)Simulation models verification for resilient communication on a highly adaptive energy-efficient computerProceedings of the 24th High Performance Computing Symposium10.22360/SpringSim.2016.HPC.055(1-8)Online publication date: 3-Apr-2016
https://dl.acm.org/doi/10.22360/SpringSim.2016.HPC.055
Zhang DWilke JHendry GDechev D(2016)Validating the Simulation of Large-Scale Parallel Applications Using Statistical CharacteristicsACM Transactions on Modeling and Performance Evaluation of Computing Systems10.1145/28097781:1(1-22)Online publication date: 12-Feb-2016
https://dl.acm.org/doi/10.1145/2809778
Barisits MKühn ELassnig MVarela CCastro HBarrios C(2016)A hybrid simulation model for data gridsProceedings of the 16th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing10.1109/CCGrid.2016.36(255-260)Online publication date: 16-May-2016
https://dl.acm.org/doi/10.1109/CCGrid.2016.36
Zhou WChen JCui CWang QDong DTang Y(2016)Detailed and clock-driven simulation for HPC interconnection networkFrontiers of Computer Science: Selected Publications from Chinese Universities10.1007/s11704-016-5035-310:5(797-811)Online publication date: 1-Oct-2016
https://dl.acm.org/doi/10.1007/s11704-016-5035-3
Geyer FSchneele SCarle G(2014)PETFENProceedings of the 8th International Conference on Performance Evaluation Methodologies and Tools10.4108/icst.Valuetools.2014.258166(25-30)Online publication date: 9-Dec-2014
https://dl.acm.org/doi/10.4108/icst.Valuetools.2014.258166
Kathiravelu PVeiga L(2014)An Adaptive Distributed Simulator for Cloud and MapReduce Algorithms and ArchitecturesProceedings of the 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing10.1109/UCC.2014.16(79-88)Online publication date: 8-Dec-2014
https://dl.acm.org/doi/10.1109/UCC.2014.16
Geyer FSchneele SCarle GHorvath ABuchholz PCortellessa VMuscariello LSquillante M(2013)Practical performance evaluation of ethernet networks with flow-level network modelingProceedings of the 7th International Conference on Performance Evaluation Methodologies and Tools10.4108/icst.valuetools.2013.254367(253-262)Online publication date: 10-Dec-2013
https://dl.acm.org/doi/10.4108/icst.valuetools.2013.254367
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten