A knowledge-based method for the validation of military simulation

ABSTRACT

The validation of modern military simulation relies heavily on the opinions of military experts, and it makes the validation task exhaustive and time-consuming. The knowledge-based methods can be applied for these problems. There are three kinds of knowledge sets in military simulation validation, namely, domain knowledge, inference knowledge and validation task knowledge. By analyzing the context of these knowledge, three types of knowledge models are developed. Based on these knowledge models, the implement of knowledge-based system is detailed. However, this validation system can be practical for the validation of military simulation by enriching the knowledge base.

REFERENCES

• 1: Balci, O. 1998. Verification, validation, and testing. In The Hand book of Simulation, 335--393. New York, NY: John Wiley & Sons.
• 2: O. Balci, How to assess the acceptability and credibility of simulation results, Proceedings of the 21st conference on Winter simulation, p.62-71, December 04-06, 1989, Washington, D.C., United States [doi>10.1145/76738.76746]
• 3: Barlas, Y. 1996. Formal aspects of model validity and validation in system dynamics. System Dynamic Review. 183--210.
• 4: Barlas, Y. and K. Kanar. 1999. A dynamic pattern-oriented test for model validation. in Proceedings of 4^th System Science European Congress. 269--286.
• 5: Louis G. Birta , F. Nur Özmizrak, A knowledge-based approach for the validation of simulation models: the foundation, ACM Transactions on Modeling and Computer Simulation (TOMACS), v.6 n.1, p.76-98, Jan. 1996 [doi>10.1145/229493.229511]
• 6: P. J. Courtois, On time and space decomposition of complex structures, Communications of the ACM, v.28 n.6, p.590-603, June 1985 [doi>10.1145/3812.3814]
• 7: Defense Modeling and Simulation Office (DMSO). 2001. Department of defense verification, validation, and accreditation recommended practices guide. Department of Defense, Alexandria, VA.
• 8: Fang Ke , Yang Ming , Wang Zicai, The HITVICE VV&A environment, Proceedings of the 37th conference on Winter simulation, December 04-07, 2005, Orlando, Florida
• 9: Joseph C. Giarratano , Gary Riley, Expert Systems: Principles and Programming, PWS Publishing Co., Boston, MA, 1994
• 10: Hofmann, M. A. 2004. Criteria for decomposing systems into components in modeling and simulation: lessons learned with military simulations. SIMULATION: the Society for Modeling and Simulation International. Jul-Aug, 357--365.
• 11: William C. Hopkinson , José A. Sepúlveda, Real time validation of man-in-the-loop simulations, Proceedings of the 27th conference on Winter simulation, p.1250-1256, December 03-06, 1995, Arlington, Virginia, United States [doi>10.1145/224401.224804]
• 12: Jack P. C. Kleijnen, Validation of models: statistical techniques and data availability, Proceedings of the 31st conference on Winter simulation: Simulation---a bridge to the future, p.647-654, December 05-08, 1999, Phoenix, Arizona, United States [doi>10.1145/324138.324450]
• 13: Averill M. Law , W. David Kelton, Simulation Modeling and Analysis, McGraw-Hill Higher Education, 1997
• 14: Min, F., P. Ma, and M. Yang. 2007. Domain knowledge elicitation and acquisition for military simulation. Submitted to Proceedings of Winter Simulation Conference.
• 15: Nicholas V. Findler , Neal M. Mazur, A system for automatic model verification and validation, Transactions of the Society for Computer Simulation International, v.6 n.3, p.153-172, Jul. 1989
• 16: Robert G. Sargent, Validation and verification of simulation models, Proceedings of the 36th conference on Winter simulation, December 05-08, 2004, Washington, D.C.
• 17: Guus T. Schreiber , Hans Akkermans, Knowledge engineering and management: the CommonKADS methodology, MIT Press, Cambridge, MA, 2000
• 18: Hengjie Song , Ping Ma , Ming Yang, The application of evaluation method based on HMM for results validity of complex simulation system, Proceedings of the 37th conference on Winter simulation, December 04-07, 2005, Orlando, Florida
• 19: Wakeland, W. and M. Hoarfrost. 2005. The case for thoroughly testing complex system dynamics.
• 20: Gwendolyn H. Walton , Robert M. Patton , Douglas J. Parsons, Usage testing of military simulation systems, Proceedings of the 33nd conference on Winter simulation, December 09-12, 2001, Arlington, Virginia
• 21: Bernard P. Zeigler, Hierarchical, modular discrete-event modelling in an object-oriented environment, Simulation, v.49 n.5, p.219-230, November 1, 1987 [doi>10.1177/003754978704900506]
• 22: Zhang, B., M. Yang, and B. Li. 2002. Integration of testing and evaluation for complex simulation system, Computer Integrated Manufacturing Systems 8(3).