skip to main content
article

A fuzzy set theoretic approach to validate simulation models

Published: 01 October 2006 Publication History

Abstract

We develop a new approach to the validation of simulation models by exploiting elements from fuzzy set theory and machine learning. A fuzzy resemblance relation concept is used to set up a mathematical framework for measuring the degree of similarity between the input-output behavior of a simulation model and the corresponding behavior of the real system. A neuro-fuzzy inference algorithm is employed to automatically learn the required resemblance relation from real and simulated data. Ultimately, defuzzification strategies are applied to obtain a coefficient on the unit interval that characterizes the degree of model validity. An example in the airline industry illustrates the practical application of this methodology.

References

[1]
Adem, J. and Martens, J. 2001. Analyzing and improving network punctuality at a Belgian airline company using simulation. DTEW Research Report 0140, K.U. Leuven.
[2]
Balci, O. 1998. Verification, validation and testing. In Handbook of Simulation, J. Banks, Ed. Wiley, New York, 335--393.
[3]
Balci, O. and Sargent, R. 1984. Validation of simulation models via simultaneous confidence intervals. Amer. J. Math. Manage. Sci. 4, 3-4, 375--406.
[4]
Barlas, Y. and Carpenter, S. 1990. Philosophical roots of model validation: Two paradigms. Syst. Dynam. Rev. 6, 2, 148--166.
[5]
De Cock, M. and Kerre, E. 2003. On (un)suitable fuzzy relations to model approximate equality. Fuzzy Sets Syst. 133, 2, 137--153.
[6]
Déry, R., Landry, M., and Banville, C. 1993. Revisiting the issue of model validation in or: an epistemological view. Europ. J. Oper. Res. 66, 2, 168--183.
[7]
Dubois, D. and Prade, H. 1980. Fuzzy Sets and Systems: Theory and Applications. Academic Press, New York.
[8]
Fishman, G. and Kiviat, P. 1967. The analysis of simulation-generated time series. Manage. Sci. 13, 7, 525--557.
[9]
Fullér, R. 1995. Neural Fuzzy Systems. Institute for Advanced Management Systems Research, Åbo.
[10]
Gupta, M. and Qi, J. 1991. Theory of t-norms and fuzzy inference methods. Fuzzy Sets Syst. 40, 3, 431--450.
[11]
Hsu, D. and Hunter, J. 1977. Analysis of simulation-generated responses using autoregressive models. Manage. Sci. 24, 2, 181--190.
[12]
Kerre, E. 1993. Introduction to the Basic Principles of Fuzzy Set Theory and Some of Its Applications. Communication and Cognition, Ghent.
[13]
Kleijnen, J. and Sargent, R. 2000. A methodology for the fitting and validation of metamodels in simulation. Europ. J. Oper. Res. 120, 1, 14--29.
[14]
Kleindorfer, G., O'Neill, L., and Ganeshan, R. 1998. Validation in simulation: Various positions in the philosophy of science. Manage. Sci. 44, 8, 1087--1099.
[15]
Law, A. and Kelton, W. 2000. Simulation Modeling and Analysis. McGraw-Hill, New York.
[16]
Martens, J. 2004. A fuzzy set and stochastic system theoretic technique to validate simulation models. Ph.D. dissertation, K. U. Leuven.
[17]
Martens, J., Wets, G., Vanthienen, J., and Mues, C. 2000. Improving a neuro-fuzzy classifier using exploratory factor analysis. Int. J. Intell. Syst. 15, 8, 785--800.
[18]
Nauck, D., Klawonn, F., and Kruse, R. 1997. Neuro-Fuzzy Systems. Wiley, Chichester.
[19]
Naylor, T. and Finger, J. 1967. Verification of computer simulation models. Manage. Sci. 14, 2, 92--101.
[20]
Sargent, R. 1994. Verification and validation of simulation models. In Proceedings of the 1994 Winter Simulation Conference. IEEE Press, Piscataway, NJ, 77--87.
[21]
Zadeh, L. 1965. Fuzzy sets. Inf. Control 8, 3, 338--353.
[22]
Zadeh, L. 1979. A theory of approximate reasoning. In Machine Intelligence, J. Hayes, D. Michie, and L. Mikulich, Eds. Elsevier, Amsterdam, 149--194.
[23]
Zeigler, B. 1976. Theory of Modeling and Simulation. Wiley, New York.
[24]
Zimmermann, J. 1991. Fuzzy Set Theory and its Applications. Kluwer Academic Publishers, Boston, MA.

Cited By

View all
  • (2022)An Inquiry into Model Validity When Addressing Complex Sustainability ChallengesComplexity10.1155/2022/11938912022Online publication date: 1-Jan-2022
  • (2021)Research on Intelligent Credibility Evaluation Method of Aircraft HWIL Simulation System Based on Complex NetworkProceedings of 2021 Chinese Intelligent Systems Conference10.1007/978-981-16-6320-8_85(824-832)Online publication date: 6-Oct-2021
  • (2010)Assertion Checking in J-Sim Simulation Models of Network ProtocolsSimulation10.1177/003754970934932686:11(651-673)Online publication date: 1-Nov-2010

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Modeling and Computer Simulation
ACM Transactions on Modeling and Computer Simulation  Volume 16, Issue 4
October 2006
82 pages
ISSN:1049-3301
EISSN:1558-1195
DOI:10.1145/1176249
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2006
Published in TOMACS Volume 16, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Nefprox
  2. resemblance relations
  3. validity grades

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)5
  • Downloads (Last 6 weeks)1
Reflects downloads up to 07 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2022)An Inquiry into Model Validity When Addressing Complex Sustainability ChallengesComplexity10.1155/2022/11938912022Online publication date: 1-Jan-2022
  • (2021)Research on Intelligent Credibility Evaluation Method of Aircraft HWIL Simulation System Based on Complex NetworkProceedings of 2021 Chinese Intelligent Systems Conference10.1007/978-981-16-6320-8_85(824-832)Online publication date: 6-Oct-2021
  • (2010)Assertion Checking in J-Sim Simulation Models of Network ProtocolsSimulation10.1177/003754970934932686:11(651-673)Online publication date: 1-Nov-2010

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media