Article

How to build valid and credible simulation models

Author:

Averill M. LawAuthors Info & Claims

WSC '06: Proceedings of the 38th conference on Winter simulation

Pages 58 - 66

Published: 03 December 2006 Publication History

Get Access

Abstract

In this tutorial we present techniques for building valid and credible simulation models. Ideas to be discussed include the importance of a definitive problem formulation, discussions with subject-matter experts, interacting with the decision-maker on a regular basis, development of a written assumptions document, structured walk-through of the assumptions document, use of sensitivity analysis to determine important model factors, and comparison of model and system output data for an existing system (if any). Each idea will be illustrated by one or more real-world examples. We will also discuss the difficulty in using formal statistical techniques (e.g., confidence intervals) to validate simulation models.

References

[1]

Balci, O. 1998. Verification, validation, and testing. In The handbook of simulation, ed. J. Banks, Chapter 10. New York: John Wiley.

Digital Library

Google Scholar

[2]

Banks, J., J. S. Carson, B. L. Nelson, and D. M. Nicol. 2005. Discrete-event system simulation. 4th ed. Upper Saddle River, N. J: Prentice-Hall.

Google Scholar

[3]

Carson J. S., June 1986. Convincing users of model's validity is challenging aspect of modeler's job. Industrial Engineering 18: 74--85.

Google Scholar

[4]

Defense Modeling and Simulation Office. 2000. VV&A recommended practices guide. Millennium Edition. http://vva.dmso.mil. Alexandria, Virginia.

Google Scholar

[5]

Law, A. M. July 1991. Simulation study puts the right heat on at Kaiser Aluminum. Industrial Engineering 23: 16--17.

Google Scholar

[6]

Law, A. M. 2006. Simulation modeling and analysis. 4th ed. New York: McGraw-Hill.

Digital Library

Google Scholar

[7]

Montgomery, D. C. 2005. Design and analysis of experiments. 6th ed. New York: John Wiley.

Digital Library

Google Scholar

[8]

Sargent, R. G. 2004. Verification and validation of simulation models. In Proceedings of the 2004 winter simulation conference. Washington, D.C., 17--28. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers.

Digital Library

Google Scholar

[9]

Schruben, L. W. 1980. Establishing the credibility of simulations. Simulation 34: 101--105.

Crossref

Google Scholar

[10]

Shannon, R. E. 1975. Systems simulation: The art and science. Englewood Cliffs, N. J.: Prentice-Hall.

Google Scholar

Cited By

View all

Montevechi JPereira TThomassie RAdams ABanerjee A(2017)Analysis of communication management in a discrete event simulation project in an high-tech manufacturing companyProceedings of the 2017 Winter Simulation Conference10.5555/3242181.3242530(1-12)Online publication date: 3-Dec-2017
https://dl.acm.org/doi/10.5555/3242181.3242530
Sargent RBalci O(2017)History of verification and validation of simulation modelsProceedings of the 2017 Winter Simulation Conference10.5555/3242181.3242199(1-16)Online publication date: 3-Dec-2017
https://dl.acm.org/doi/10.5555/3242181.3242199
Montevechi JPereira Tda Silva Cde C. Miranda RScheidegger A(2015)Identification of the main methods used in simulation projectsProceedings of the 2015 Winter Simulation Conference10.5555/2888619.2889087(3469-3480)Online publication date: 6-Dec-2015
https://dl.acm.org/doi/10.5555/2888619.2889087
Show More Cited By

Recommendations

How to build valid and credible simulation models
WSC '09: Winter Simulation Conference

In this tutorial we present techniques for building valid and credible simulation models. Ideas to be discussed include the importance of a definitive problem formulation, discussions with subject-matter experts, interacting with the decision-maker on a ...
How to Build Valid and Credible Simulation Models
WSC '22: Proceedings of the Winter Simulation Conference

In this tutorial we present techniques for building valid and credible simulation models. Ideas to be discussed include the importance of a definitive problem formulation, discussions with subject-matter experts, interacting with the decision-maker on a ...
How to build valid and credible simulation models
WSC '19: Proceedings of the Winter Simulation Conference

In this tutorial we present techniques for building valid and credible simulation models. Ideas to be discussed include the importance of a definitive problem formulation, discussions with subject-matter experts, interacting with the decision-maker on a ...

Comments

Information & Contributors

Information

Published In

WSC '06: Proceedings of the 38th conference on Winter simulation

December 2006

2429 pages

ISBN:1424405017

Editors:
L. Felipe Perrone
Bucknell University
,
Barry G. Lawson
University of Richmond
,
Jason Liu
Colorado School of Mines
,
Frederick P. Wieland
Sensis Corporation
,
General Chair:
David Nicol
University of Illinois, Urbana-Champaign
,
Program Chair:
Richard Fujimoto
College of Computing, Georgia Tech

Publisher

Winter Simulation Conference

Publication History

Published: 03 December 2006

Check for updates

Qualifiers

Article

Conference

WSC06

Sponsor:

IIE
ASA
IEICE ESS
IEEE-CS\DATC
SIGSIM
NIST
(SCS)
INFORMS-CS

WSC06: Winter Simulation Conference 2006

December 3 - 6, 2006

California, Monterey

Acceptance Rates

WSC '06 Paper Acceptance Rate 177 of 252 submissions, 70%;

Overall Acceptance Rate 3,413 of 5,075 submissions, 67%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
472
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Montevechi JPereira TThomassie RAdams ABanerjee A(2017)Analysis of communication management in a discrete event simulation project in an high-tech manufacturing companyProceedings of the 2017 Winter Simulation Conference10.5555/3242181.3242530(1-12)Online publication date: 3-Dec-2017
https://dl.acm.org/doi/10.5555/3242181.3242530
Sargent RBalci O(2017)History of verification and validation of simulation modelsProceedings of the 2017 Winter Simulation Conference10.5555/3242181.3242199(1-16)Online publication date: 3-Dec-2017
https://dl.acm.org/doi/10.5555/3242181.3242199
Montevechi JPereira Tda Silva Cde C. Miranda RScheidegger A(2015)Identification of the main methods used in simulation projectsProceedings of the 2015 Winter Simulation Conference10.5555/2888619.2889087(3469-3480)Online publication date: 6-Dec-2015
https://dl.acm.org/doi/10.5555/2888619.2889087
Montevechi JLeal Fde Carvalho Miranda RPereira THill RKuhl M(2013)Interactive learning of modeling and discrete-events simulation through Lego® partsProceedings of the 2013 Winter Simulation Conference: Simulation: Making Decisions in a Complex World10.5555/2675983.2675838(3556-3567)Online publication date: 8-Dec-2013
https://dl.acm.org/doi/10.5555/2675983.2675838
Fishwick PRose OUhrmacher A(2012)A tutorial on simulation modeling in six dimensionsProceedings of the Winter Simulation Conference10.5555/2429759.2429982(1-12)Online publication date: 9-Dec-2012
https://dl.acm.org/doi/10.5555/2429759.2429982
Avni TGreenland ADunkin AIngalls R(2009)Communicating with management about the benefits of business process simulationWinter Simulation Conference10.5555/1995456.1995852(2915-2919)Online publication date: 13-Dec-2009
https://dl.acm.org/doi/10.5555/1995456.1995852

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Recommendations