Nigel Tracey
ABSTRACT
One of the major costs in a software project is the construction of test-data. This paper outlines a generalised test-case data generation framework based on optimisation techniques. The framework can incorporate a number of testing criteria, for both functional and non-functional properties. Application of the optimisation framework to testing specification failures and exception conditions is illustrated. The results of a number of small case studies are presented and show the efficiency and effectiveness of this dynamic optimisation-base approach to generating test-data.
- 1.E. H~ L. Aarts and J. Korst. Simulated Aneealing and Boltzmann Machines. Wiley, 1988.Google Scholar
- 2.J. Barnes. High Integrity Ada: The 'SPARK Approach. Addison-Wesley, 1997.Google Scholar
- 3.B. Beizer. Software Testing Techniques. Thomson Computer Press, 2nd edition, 1990. Google ScholarDigital Library
- 4.J. Clark and N. Tracey. Solving constraints in law 22117. Law/d5.1.1(e), European Commission - DG HI Industry, 1997. Legacey Assessment Worbence Feasibility Assessment.Google Scholar
- 5.L. Clarke. A system to generate test data and symbolically execute programs. IEEE Transactions on Software Engineering, SE-2(3):215-222, September 1976.Google ScholarDigital Library
- 6.R. Demillo and A. Offutt. Constraint-based automatic test data generation. IEEE Transactions on Software Engineering, 17(9)~900-910, 1991. Google ScholarDigital Library
- 7.K. A. Dowsland. Modem Heuristic Techniques for Combinatorial Problems, chfipter 2 - Simulated Annealing, pages .20-69. McGraw Hill, 1993. Google ScholarDigital Library
- 8.F. Glover and M. Laguna'. Modem Heuristic Techniques for Combinatorial Problems, chapter 3- Tabu Search, pages 70- 150. McGraw Hill, 1993. Google ScholarDigital Library
- 9.D- B. Goldberg. Genetic Algorithms in Search, Optimisation and Machine Learing. Addison-Wesley, 1989. Google ScholarDigital Library
- 10.B. Jones, H. Sthamer, and D. Eyres. Automatic structural testing using genetic algorithms. Software Engineering Journal, 11(5):299-306, 1996.Google ScholarCross Ref
- 11.S. Kirkpatrick, J. C. D. Gelatt, and M. P. Vecchi. Optimization by simulated annealing. Science, 220(4598):671--680, May 1983.Google ScholarCross Ref
- 12.B. Korel. Automated software test data generation. IEEE ransactions oti Software Engineering, 16(8):870-879, 1990. Google ScholarDigital Library
- 13.B. Korel. Automated test data generation for programs with procedures. ACM I¿TA, pages 209-215, 1996. Google ScholarDigital Library
- 14.N. Metropolis, A. W. Rosenbluth, A. H. Teller, and E. Teller. Equation of state calculation by fast computing machine. Journal of Chem. Phys., 21:1087-1091, 1953.Google ScholarCross Ref
- 15.W. Miller and D. Spooner. Automatic generation of floatingpoint test data. IEEE Transactions on Software Engineering, SE-2(3):223-226, September 1976.Google ScholarDigital Library
- 16.A.J. Offutt and J. Pan. The dynamic domain reduction procedure for test data generation. http://www, isse. gmu. edu/faculty/ofut/rsrch/atdg, htrnl, 1996. Google ScholarDigital Library
- 17.M. Duld. Tesintg - a challenge to method and tool developers. Software Engineering Journal, 6(2):59---64, March 1991. Google ScholarDigital Library
- 18.Praxis Critical Systems.'$park-Ada Documentation 2.0,1995.Google Scholar
- 19.V. J. Rayward-Smith, I. H. Osman, C. R. Reeves, and G. D. Smith, editors. Modern Heuristic Search Methods. Wiley, 1996.Google Scholar
- 20.N. Trace),, J. Clark, and K. Mander. The way forward for unifying dynamic test case generation: The optimisation-based approach. In Dependable Computing and Its Applications- To appear. IFIP, 1998.'Google Scholar
- 21.N. J. Tracey. Test-case data generation using optimisation techniques - first year dphil report. Department of Computer Science, University of York, 1997.Google Scholar
- 22.X. Yang. The automatic generation of software test data from z specifications. Technical report, Department of Computer Studies, University of Glamorgan, 1995.Google Scholar
Index Terms
- Automated program flaw finding using simulated annealing
Recommendations
Automated program flaw finding using simulated annealing
One of the major costs in a software project is the construction of test-data. This paper outlines a generalised test-case data generation framework based on optimisation techniques. The framework can incorporate a number of testing criteria, for both ...
Data Generation for Path Testing
We present two stochastic search algorithms for generating test cases that execute specified paths in a program. The two algorithms are: a simulated annealing algorithm (SA), and a genetic algorithm (GA). These algorithms are based on an optimization ...
Diversity oriented test data generation using metaheuristic search techniques
We present a new test data generation technique which uses the concept of diversity of test sets as a basis for the diversity oriented test data generation - DOTG. Using DOTG we translate into an automatic test data generation technique the intuitive ...
Comments