A process for identifying changes when source code is not available

ABSTRACT

Various regression test selection techniques have been developed and shown to improve fault detection effectiveness. The majority of these test selection techniques rely on access to source code for change identification. However, when new releases of COTS components are made available for integration and testing, source code is often not available to guide regression test selection. This paper describes a process for identifying changed functions when code is not available. This change information is beneficial for selecting white-box regression tests of customer/glue code. This process is applicable when COTS licensing agreements do not preclude decompilation. A feasibility study of the process was conducted with four releases of a medium-scale internal ABB product. The results of the feasibility study indicate that this process can be effective in identifying changed functions.

REFERENCES

• 1: Victor R. Basili , Barry Boehm, COTS-Based Systems Top 10 List, Computer, v.34 n.5, p.91-93, May 2001 [doi>10.1109/2.920618 ]
• 2: John Bible , Gregg Rothermel , David S. Rosenblum, A comparative study of coarse- and fine-grained safe regression test-selection techniques, ACM Transactions on Software Engineering and Methodology (TOSEM), v.10 n.2, p.149-183, April 2001 [doi>10.1145/367008.367015]
• 3: Gao, J. and Wu, Y., "Testing Component-Based Software - Issues, Challenges, and Solutions," in 3rd International Conference on COTS-Based Software Systems. Redondo Beach, Jan. 2004, pp.
• 4: Todd L. Graves , Mary Jean Harrold , Jung-Min Kim , Adam Porter , Gregg Rothermel, An empirical study of regression test selection techniques, ACM Transactions on Software Engineering and Methodology (TOSEM), v.10 n.2, p.184-208, April 2001 [doi>10.1145/367008.367020]
• 5: IEEE, "IEEE Standard Glossary of Software Engineering Terminology," IEEE Standard 610.12, 1990, pp.
• 6: Laski, J. and Szermer, W., "Identification of program modifications and its applications in software maintenance," International Conference on Software Maintenance, Nov. 1992, pp. 282--290.
• 7: Leung, H. and White, L., "A Study of Integration Testing and Software Regression at the Integration Level," International Conference on Software Maintenance, San Diego, 1990, pp. 290--301.
• 8: Anneliese von Mayrhauser , Richard T. Mraz , Jeff Walls, Domain Based Regression Testing, Proceedings of the International Conference on Software Maintenance, p.26-35, September 01, 1994
• 9: Gregg Rothermel , Mary Jean Harrold, Analyzing Regression Test Selection Techniques, IEEE Transactions on Software Engineering, v.22 n.8, p.529-551, August 1996 [doi>10.1109/32.536955 ]
• 10: F. I. Vokolos , P. G. Frankl, Pythia: a regression test selection tool based on textual differencing, IFIP TC5 WG5.4 3rd internatinal conference on on Reliability, quality and safety of software-intensive systems, p.3-21, January 1997, Athens, Greece
• 11: F. I. Vokolos , P. G. Frankl, Empirical Evaluation of the Textual Differencing Regression Testing Technique, Proceedings of the International Conference on Software Maintenance, p.44, March 16-19, 1998

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.4 Software/Program Verification

General Terms:
Reliability, Verification

Keywords:
COTS, change identification