skip to main content
10.1145/1353673.1353681acmconferencesArticle/Chapter ViewAbstractPublication PagesaseConference Proceedingsconference-collections
research-article

A survey on model-based testing approaches: a systematic review

Published: 05 November 2007 Publication History

Abstract

This paper describes a systematic review performed on model-based testing (MBT) approaches. A selection criterion was used to narrow the initially identified four hundred and six papers to focus on seventy-eight papers. Detailed analysis of these papers shows where MBT approaches have been applied, the characteristics, and the limitations. The comparison criteria includes representation models, support tools, test coverage criteria, the level of automation, intermediate models, and the complexity. This paper defines and explains the review methodology and presents some results.

References

[1]
S. Dalal et al. (1999), "Model-based testing in practice", In: ICSE'99, May, pp. 285--294.
[2]
A. Pretschner (2005), "Model-based testing", In:ICSE, p.722--723.
[3]
G. M. Lima, G. H. Travassos (2005), "A Strategy for Object-Oriented Software Integration Testing". In: LATW'2005.
[4]
M. Vieira, J. Leduc, B. Hasling, R. Subramanyan and J. Kazmeier (2006), "Automation of GUI testing using a model-driven approach", In: AST'06, ACM Press.
[5]
J. Edvardsson (1999), "A survey on automatic test data generation". In: 2nd ECSEL, pages 21--28. October.
[6]
A. Hartman (2002), "Model Based Test Generation Survey", Technical Report, available on 11/2006 at http://www.agedis.de/downloads.shtml.
[7]
M. Prasanna et al. (2005), "Survey on Automatic Test Case Generation", Academic Open Internet Journal, available at http://www.acadjournal.com/2005/v15/part6/p4/.
[8]
B. Kitchenham (2004), "Procedures for Performing Systematic Review", Joint Technical Report Software Engineering Group, Department of Computer Science Keele University, UK, and Empirical Software Engineering, National ICT Australia Ltd.
[9]
J. Biolchini, P. G. Mian, A. C. Natali, G. H. Travassos (2005), "Systematic Review in Software Engineering: Relevance and Utility", Technical Report ES-679/05, PESC-COPPE/UFRJ. Available at http://www.cos.ufrj.br.
[10]
A. C. Dias Neto, G. H. Travassos, R. Subramanyan, M. Vieira (2007), "Characterization of Model-based Software Testing Approaches", TechnicalReportES-713/07, PESC-COPPE/UFRJ. Available at http://www.cos.ufrj.br/uploadfiles/1188491168.pdf.
[11]
J. Chang, D. J. Richardson (1999), "Structural specification-based testing: automated support and experimental evaluation", In: 7th ESEC, ACM Press, pp. 285--302.
[12]
I. Parissis, F. Ouabdesselam (1996), "Specification-based testing of synchronous software", In: Symposium on the Foundations of Software Engineering (21), pp. 127--134.
[13]
L. C. Briand, Y. Labiche (2002), "A UML-Based Approach to System Testing", Technical report, Carleton University.
[14]
C. Mingsong, Q. Xiaokang, L. Xuandong (2006), "Automatic test case generation for UML activity diagrams", In: AST '06, ACM Press.
[15]
K. Stobie (2005), "Model Based Testing in Practice at Microsoft", Electronic Notes in Theoretical Computer Science 111(SPEC ISS), 5--12.
[16]
A. Bertolino, E. Marchetti, A. Polini. (2003), "Integration of 'components' to test software components", Electronic Notes in Theoretical Computer Science, 82(6), pp.49--59.
[17]
A. Gargantini, C. Heitmeyer (1999), "Using model checking to generate tests from requirements specifications", In: ESEC/FSE-7, ACM Press.
[18]
M. Satpathy, M. Leuschel, M Butler (2005), "ProTest: An Automatic Test Environment for B Specifications", In: Electronic Notes in Theoretical Computer Science, 113--136.
[19]
L. Tan, O. Sokolsky, I. Lee (2004), "Specification-based testing with linear temporal logic", In: IRI'2004, 493--498.
[20]
M. Utting, A. Pretschner, B. Legeard, B., "A taxonomy of model-based testing", Technical report 04/2006, Department of Computer Science, University of Waikato, April, 2006.
[21]
R. Spinola, M. Kalinowski, G. Travassos (2004), "A Mechanism for CASE Tools Integration", Brazilian Symposium on Software Engineering (SBES), Brasília (in Portuguese).
[22]
P. Rodriguez-Gianolli, J. Mylopoulos (2001), "A Semantic Approach to XML-based Data Integration". In:20th ICCM, Japan.
[23]
Z. Cui, M. D. J. Cox, D. M. Jones (2001), "An Environment for Managing Enterprise Domain Ontologies". M. Rossi and K. Siau (eds.) Information Modelling in the New Millennium, Idea Group Publishing, London.
[24]
N. Juristo, A. M. Moreno, S. Vegas (2004) "Reviewing 25 years of testing technique experiments". Empirical Software Engineering: An International Journal, 9, March.

Cited By

View all
  • (2024)S3C: Spatial Semantic Scene Coverage for Autonomous VehiclesProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3639178(1-13)Online publication date: 20-May-2024
  • (2024)Software Testing on E-Commerce Application Using Model-Based Testing Markov Chain2024 2nd International Conference on Software Engineering and Information Technology (ICoSEIT)10.1109/ICoSEIT60086.2024.10497492(287-292)Online publication date: 28-Feb-2024
  • (2024)Coverage measurement in model-based testing of web applications: Tool support and an industrial experience report2024 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)10.1109/ICSTW60967.2024.00019(37-43)Online publication date: 27-May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
WEASELTech '07: Proceedings of the 1st ACM international workshop on Empirical assessment of software engineering languages and technologies: held in conjunction with the 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE) 2007
November 2007
59 pages
ISBN:9781595938800
DOI:10.1145/1353673
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 November 2007

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. model-based testing
  2. survey
  3. systematic review
  4. test case generation
  5. testing approaches

Qualifiers

  • Research-article

Conference

ASE07
Sponsor:

Acceptance Rates

WEASELTech '07 Paper Acceptance Rate 11 of 15 submissions, 73%;
Overall Acceptance Rate 11 of 15 submissions, 73%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)91
  • Downloads (Last 6 weeks)13
Reflects downloads up to 07 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)S3C: Spatial Semantic Scene Coverage for Autonomous VehiclesProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3639178(1-13)Online publication date: 20-May-2024
  • (2024)Software Testing on E-Commerce Application Using Model-Based Testing Markov Chain2024 2nd International Conference on Software Engineering and Information Technology (ICoSEIT)10.1109/ICoSEIT60086.2024.10497492(287-292)Online publication date: 28-Feb-2024
  • (2024)Coverage measurement in model-based testing of web applications: Tool support and an industrial experience report2024 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)10.1109/ICSTW60967.2024.00019(37-43)Online publication date: 27-May-2024
  • (2024)Automatic testing of runtime enforcers with Test4EnforcersJournal of Systems and Software10.1016/j.jss.2023.111949210(111949)Online publication date: Apr-2024
  • (2024)Model-Based Testing Approach for Financial Technology Platforms: An Industrial ImplementationTools and Methods of Program Analysis10.1007/978-3-031-50423-5_8(83-93)Online publication date: 3-Jan-2024
  • (2024)Early Detection of Tasks with Uncommonly Long Run Duration in Post-trade SystemsTools and Methods of Program Analysis10.1007/978-3-031-50423-5_6(64-74)Online publication date: 3-Jan-2024
  • (2023)Leveraging Android Automated Testing to Assist Crowdsourced TestingIEEE Transactions on Software Engineering10.1109/TSE.2022.321687949:4(2318-2336)Online publication date: 1-Apr-2023
  • (2023)AdapTV+: Enhancing Model-Based Test Adaptation for Smart TVs through Icon Recognition2023 IEEE 28th Pacific Rim International Symposium on Dependable Computing (PRDC)10.1109/PRDC59308.2023.00033(209-216)Online publication date: 24-Oct-2023
  • (2023)Automated Test Case Generation for Safety-Critical Software in Scade2023 IEEE/ACM 45th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP)10.1109/ICSE-SEIP58684.2023.00049(483-494)Online publication date: May-2023
  • (2023)Parameterized Search Heuristic Prediction for Concolic Execution2023 30th Asia-Pacific Software Engineering Conference (APSEC)10.1109/APSEC60848.2023.00050(396-404)Online publication date: 4-Dec-2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media