David Schuler
Andreas Zeller
ABSTRACT
To assess the quality of a test suite, one can use mutation testing - seeding artificial defects (mutations) into the program and checking whether the test suite finds them. Javalanche is an open source framework for mutation testing Java programs with a special focus on automation, efficiency, and effectiveness. In particular, Javalanche assesses the impact of individual mutations to effectively weed out equivalent mutants; it has been demonstrated to work on programs with up to 100,000 lines of code.
- R. A. DeMillo, D. S. Guindi, K. N. King, W. M. McCracken, and A. J. Offutt. An extended overview of the Mothra software testing environment. In Proceedings of the Second Workshop on Software Testing, Verification, and Analysis, pages 142--151, Banff, Alberta, 1988. IEEE Computer Society Press.Google Scholar
Cross Ref
- B. J. M. Grün, D. Schuler, and A. Zeller. The impact of equivalent mutants. In Mutation 2009: International Workshop on Mutation Analysis, Apr. 2009.Google ScholarDigital Library
- A. J. Offutt, A. Lee, G. Rothermel, R. H. Untch, and C. Zapf. An experimental determination of sufficient mutant operators. ACM Transactions on Software Engineering and Methodology (TOSEM), 5(2):99--118, 1996. Google ScholarDigital Library
- A. J. Offutt and R. H. Untch. Mutation 2000: Uniting the orthogonal, pages 34--44. Kluwer Academic Publishers, Norwell, MA, USA, 2001.Google Scholar
- D. Schuler, V. Dallmeier, and A. Zeller. Efficient mutation testing by checking invariant violations. In ISSTA '09: Proceedings of the 2009 International Symposium on Software Testing and Analysis, July 2009. To appear. Google ScholarDigital Library
- R. H. Untch, A. J. Offutt, and M. J. Harrold. Mutation analysis using mutant schemata. In ISSTA '93: Proceedings of the 1993 International Symposium on Software Testing and Analysis, pages 139--148, New York, NY, USA, 1993. ACM. Google ScholarDigital Library
Index Terms
- Javalanche: efficient mutation testing for Java
Recommendations
Predictive mutation testing
ISSTA 2016: Proceedings of the 25th International Symposium on Software Testing and AnalysisMutation testing is a powerful methodology for evaluating test suite quality. In mutation testing, a large number of mutants are generated and executed against the test suite to check the ratio of killed mutants. Therefore, mutation testing is widely ...
Mitigating the effects of flaky tests on mutation testing
ISSTA 2019: Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and AnalysisMutation testing is widely used in research as a metric for evaluating the quality of test suites. Mutation testing runs the test suite on generated mutants (variants of the code under test), where a test suite kills a mutant if any of the tests fail ...
Faster mutation testing inspired by test prioritization and reduction
ISSTA 2013: Proceedings of the 2013 International Symposium on Software Testing and AnalysisMutation testing is a well-known but costly approach for determining test adequacy. The central idea behind the approach is to generate mutants, which are small syntactic transformations of the program under test, and then to measure for a given test ...
Comments