Article

Improving confidence in network simulations

Author:

Michele C. WeigleAuthors Info & Claims

WSC '06: Proceedings of the 38th conference on Winter simulation

Pages 2188 - 2194

Published: 03 December 2006 Publication History

Abstract

Simulation has become the tool of choice for an increasing number of networking researchers. Unfortunately, standard statistical techniques often cannot be applied when Internetlike heavy-tailed workloads are used as input. We present issues involved in using heavy-tailed distributions in network simulations, including three different methods for dealing with such distributions in simulation. We also discuss the proper use of the random number generator implemented in the ns-2 simulator and the impacts of improper usage.

References

[1]

Alexopoulos, C., and A. F. Seila. 2001. Output data analysis for simulations. In Proceedings of the Winter Simulation Conference, 115--122.

Digital Library

[2]

Alparslan, O., N. Akar, and E. Karasan. 2004. AIMD-based online MPLS traffic engineering for TCP flows via distributed multi-path routing. Annales Des Telecommunications.

[3]

Breslau, L., D. Estrin, K. Fall, S. Floyd, J. Heidemann, A. Helmy, P. Huang, S. McCanne, K. Varadhan, Y. Xu, and H. Yu. 2000, May. Advances in network simulation. IEEE Computer 33 (5): 59--67.

Digital Library

[4]

Cao, J., W. S. Cleveland, Y. Gao, K. Jeffay, F. D. Smith, and M. C. Weigle. 2004, March. Stochastic models for generating synthetic HTTP source traffic. In Proceedings of IEEE INFOCOM. Hong Kong.

[5]

Claypool, M., R. Kinicki, and M. Hartling. 2004, April. Active queue management for web traffic. In Proceedings of IEEE International Performance, Computing, and Communications Conference (IPCCC).

[6]

Crovella, M., and L. Lipsky. 1997. Long-lasting transient conditions in simulations with heavy-tailed workloads. In Proceedings of the Winter Simulation Conference, 1005--1012. Atlanta, GA.

Digital Library

[7]

Fall, K., and K. Varadhan. (Eds.) 2006. ns Manual. <www.isi.edu/nsnam/ns/doc/ns_doc.pdf>.

[8]

Fishman, G. 2001. Discrete-event simulation: Modeling, programming, and analysis. Springer-Verlag.

Digital Library

[9]

Fishman, G. S., and I. J. B. F. Adan. 2006. How heavy-tailed distributions affect simulation-generated time averages. ACM Transactions on Modeling and Computer Simulation. To appear.

Digital Library

[10]

Harchol-Balter, M., M. Crovella, and C. Murta. 1999, November. On choosing a task assignment policy for a distributed server system. Journal of Parallel and Distributed Computing, Special issue on software support for distributed computing 59 (2): 204--228.

Digital Library

[11]

Houtzager, G., and C. Williamson. 2003. A packet-level simulation study of optimal web proxy cache placement. In Proceedings of IEEE MASCOTS.

[12]

Kurkowski, S., T. Camp, and M. Colagrosso. 2005, October. MANET simulation studies: The incredibles. ACM SIGMOBILE Mobile Computing and Communications Review 9 (4): 50--61.

Digital Library

[13]

Law, A. M. 2004. Statistical analysis of simulation outputdata: The practical state of the art. In Proceedings of the Winter Simulation Conference, 67--72.

Digital Library

[14]

L'Ecuyer, P. 1999. Good parameters and implementations for combined multiple recursive random number generators. Operations Research 47 (1): 159--164.

Digital Library

[15]

L'Ecuyer, P. 2001. Software for uniform random number generation: Distinguishing the good and the bad. In Proceedings of the Winter Simulation Conference, 95--105.

Digital Library

[16]

L'Ecuyer, P., R. Simard, E. J. Chen, and W. D. Kelton. 2002, November. An object-oriented random-number package with many long streams and substreams. Operations Research 50 (6): 1073--1075. Software available at <www.iro.umontreal.ca/~lecuyer/myftp/streamsOO/>.

Digital Library

[17]

Mah, B. 1997. An empirical model of HTTP network traffic. In Proceedings of IEEE INFOCOM, 592--600.

Digital Library

[18]

May, M., T. Bonald, and J. Bolot. 2000, March. Analytic evaluation of RED performance. In Proceedings of IEEE INFOCOM, 1415--1424.

[19]

Nakayama, M. K. 2002. Simualtion output analysis. In Proceedings of the Winter Simulation Conference, 23--34.

Digital Library

[20]

Ott, T., T. Lakshman, and L. Wong. 1999, March. SRED: Stabilized RED. In Proceedings of IEEE INFOCOM, 1346--1355.

[21]

Park, K., G. Kim, and M. Crovella. 1996. On the relationship between file sizes, transport protocols, and self-similar network traffic. In Proceedings of the IEEE International Conference on Network Protocols (ICNP).

Digital Library

[22]

Pawlikowski, K. 2003, February. Do not trust all simulation studies of telecommunications networks. In Proceedings of the International Conference on Information Networking (ICOIN).

[23]

Pawlikowski, K., H.-D. J. Jeong, and J.-S. R. Lee. 2002, January. On credibility of simulation studies of telecommunication networks. IEEE Communications Magazine 40 (1): 132--139.

Digital Library

[24]

Perrone, L., Y. Yuan, and D. Nicol. 2003. Modeling and simulation best practices for wireless ad hoc networks. In Proceedings of the Winter Simulation Conference, 685--693.

Digital Library

[25]

Rai, I. A., G. Urvoy-Keller, and E. W. Biersack. 2003. Analysis of LAS scheduling for job size distributions with high variance. In Proceedings of ACM SIGMETRICS, 218--228.

Digital Library

[26]

Urvoy-Keller, G., and E. Biersack. 2002, October. A multicast congestion control model for overlay networks and its performance. In Proceedings of the Workshop on Networked Group Communication.

[27]

Weigle, M. C., K. Jeffay, and F. D. Smith. 2005, May. Delay-based early congestion detection and adaptation in TCP: Impact on web performance. Computer Communications 28 (8): 837--850.

Digital Library

[28]

Williamson, C., and N. Markatchev. 2003, July. Networklevel impacts on user-level web performance. In Proceedings of SPECTS.

Cited By

Cheng YÇetinkaya ESterbenz JHimmelspach JVanmechelen KCai W(2013)Transactional traffic generator implementation in ns-3Proceedings of the 6th International ICST Conference on Simulation Tools and Techniques10.5555/2512734.2512759(182-189)Online publication date: 5-Mar-2013
https://dl.acm.org/doi/10.5555/2512734.2512759
Rojas-Mora JJiménez TAltman ELasaulce SFiems DHarrison PVandendorpe L(2011)Simulating flow level bandwidth sharing with pareto distributed file sizesProceedings of the 5th International ICST Conference on Performance Evaluation Methodologies and Tools10.5555/2151688.2151718(265-273)Online publication date: 16-May-2011
https://dl.acm.org/doi/10.5555/2151688.2151718
Yoon SLim KKim J(2010)Cross-layer dynamic spectrum map management framework for white space applicationsEURASIP Journal on Wireless Communications and Networking10.1155/2010/8709762010(1-16)Online publication date: 1-Feb-2010
https://dl.acm.org/doi/10.1155/2010/870976

Recommendations

Expanding confidence in network simulations

Networking engineers increasingly depend on simulation to design and deploy complex, heterogeneous networks. Similarly, networking researchers increasingly depend on simulation to investigate the behavior and performance of new protocol designs. Despite ...
Improving performance of parallel simulation kernel for wireless network simulations
MILCOM'06: Proceedings of the 2006 IEEE conference on Military communications

For decades, simulations have been the means to study the behavior and analyze the performance of engineering, computer science, and military applications. In the sequential discrete-event driven simulations, the events are executed sequentially in an ...
Robustness of confidence intervals for transient simulations
WSC '77: Proceedings of the 9th conference on Winter simulation - Volume 1

Most of the statistical simulation literature is concerned with steady-state simulations. That is, a simulation where the quantity to be estimated is defined as a limit as time (or the number of customers) goes to infinity. For example, the regenerative ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WSC '06: Proceedings of the 38th conference on Winter simulation

December 2006

2429 pages

ISBN:1424405017

Editors:
L. Felipe Perrone
Bucknell University
,
Barry G. Lawson
University of Richmond
,
Jason Liu
Colorado School of Mines
,
Frederick P. Wieland
Sensis Corporation
,
General Chair:
David Nicol
University of Illinois, Urbana-Champaign
,
Program Chair:
Richard Fujimoto
College of Computing, Georgia Tech

Sponsors

IIE: Institute of Industrial Engineers
ASA: American Statistical Association
IEICE ESS: Institute of Electronics, Information and Communication Engineers, Engineering Sciences Society
IEEE-CS\DATC: The IEEE Computer Society
SIGSIM: ACM Special Interest Group on Simulation and Modeling
NIST: National Institute of Standards and Technology
(SCS): The Society for Modeling and Simulation International
INFORMS-CS: Institute for Operations Research and the Management Sciences-College on Simulation

Publisher

Winter Simulation Conference

Publication History

Published: 03 December 2006

Check for updates

Qualifiers

Article

Conference

WSC06

Sponsor:

IIE
ASA
IEICE ESS
IEEE-CS\DATC
SIGSIM
NIST
(SCS)
INFORMS-CS

WSC06: Winter Simulation Conference 2006

December 3 - 6, 2006

California, Monterey

Acceptance Rates

WSC '06 Paper Acceptance Rate 177 of 252 submissions, 70%;

Overall Acceptance Rate 3,413 of 5,075 submissions, 67%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
261
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cheng YÇetinkaya ESterbenz JHimmelspach JVanmechelen KCai W(2013)Transactional traffic generator implementation in ns-3Proceedings of the 6th International ICST Conference on Simulation Tools and Techniques10.5555/2512734.2512759(182-189)Online publication date: 5-Mar-2013
https://dl.acm.org/doi/10.5555/2512734.2512759
Rojas-Mora JJiménez TAltman ELasaulce SFiems DHarrison PVandendorpe L(2011)Simulating flow level bandwidth sharing with pareto distributed file sizesProceedings of the 5th International ICST Conference on Performance Evaluation Methodologies and Tools10.5555/2151688.2151718(265-273)Online publication date: 16-May-2011
https://dl.acm.org/doi/10.5555/2151688.2151718
Yoon SLim KKim J(2010)Cross-layer dynamic spectrum map management framework for white space applicationsEURASIP Journal on Wireless Communications and Networking10.1155/2010/8709762010(1-16)Online publication date: 1-Feb-2010
https://dl.acm.org/doi/10.1155/2010/870976

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten