skip to main content
10.1145/1083217.1083223acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicseConference Proceedingsconference-collections
Article

Towards software architecture-based regression testing

Published: 17 May 2005 Publication History

Abstract

When architecting dependable systems, in addition to improving system dependability by means of construction (fault-tolerant and redundant mechanisms, for instance), it is also important to evaluate, and thereby confirm, system dependability. There are many different approaches for evaluating system dependability, and testing always has been an important one.Previous work on software architecture testing has shown it is possible to apply conformance-testing techniques to yield confidence that the behavior of an implemented system conforms to the expected behavior of the software architecture, specified with Architecture Description Languages.In this work, we explore how regression testing can be systematically applied at the software architecture level in order to reduce the cost of retesting modified systems, and also to assess the regression testability of the evolved system. We consider assessing both "top-down" and "bottom-up" evolution, i.e., whether a slightly modified implementation conforms to the initial architecture, and whether the (modified) implementation conforms an evolved architecture. A better understanding on how regression testing can be applied at the software architecture level will help us to assess and identify architecture with higher dependability.

References

[1]
R. J. Allen, R. Douence, D. Garlan. Specifying and Analyzing Dynamic Software Architectures. In Proc. of the 1998 Conf. on Fundamental Approaches to Software Engineering (FASE '98), March 1998.
[2]
S. Beydeda, and V. Gruhn. Integrating White-and Black-Box Techniques for Class-Level Regression Testing. In Proc. COMPSAC 2001, pp. 357--362.
[3]
A. Bucchiarone, H. Muccini, P. Pelliccione, and P. Pierini. Model-Checking plus Testing: from Software Architecture Analysis to Code Testing. In Proc. Int. Work. on Integration of Testing Methodologies, ITM '04. October 2004.
[4]
The C2 Architectural Style. On-line at: http://www.ics.uci.edu/pub/arch/c2.html.
[5]
Dias, M., Vieira, M., Richardson, D., Analyzing Software Architecture with Argus-I, In Proc of the 22nd International Conference on Software Engineering (ICSE 2000), Limerick, Ireland, June 2000, pp. 758--761.
[6]
Formal Methods for Software Architectures. Tutorial book on Software Architectures and Formal Methods. In SFM-03:SA Lectures, Eds. M. Bernardo and P. Inverardi, LNCS 2804, 2003.
[7]
D. Garlan. Software Architecture: a Roadmap. In A. Finkelstein (Ed.), ACM ICSE 2000, The Future of Software Engineering, pp. 91--101, 2000.
[8]
T. L. Graves, M. J. Harrold, J.-M. Kim, A. Porter and G. Rothermel. An Empirical Study of Regression Test Selection Techniques. In Proc. of the 20th Int. Conf. on Software Engineering (ICSE'98), pp. 188--197, Japan, April 1998.
[9]
M. J. Harrold. Architecture-Based Regression Testing of Evolving Systems. In Proc. Int. Workshop on the ROle of Software Architecture in TEsting and Analysis (ROSATEA), CNR-NSF, pp. 73--77, July 1998.
[10]
M. J. Harrold. Testing: A Roadmap. In A. Finkelstein (Ed.), ACM ICSE 2000, The Future of Software Engineering, pp. 61--72, 2000.
[11]
M. J. Harrold, A. Orso, D. Rosenblum, G. Rothermel, M. L. Soffa, and H. Do. Using Component Metadata to Support the Regression Testing of Component-Based Software. In Proc. Int. Conf. on Software Maintenance, Nov. 2001.
[12]
J. Kramer and J. Magee. Analysing Dynamic Change in Software Architectures: A case study. In Proc. 4th IEEE Int. Conf. on Configurable Distributed Systems, Annapolis, May 1998.
[13]
D. Kung, J. Gao, P. Hsia, Y. Toyoshima, C. Chen, Y. Kim, and Y. Song Developing an Object-Oriented Software Testing and Maintenance Environment. In Comm. of the ACM, Oct 1995.
[14]
Labelled Transition System Analyzer (LTSA). On-line at: http://www.doc.ic.ac.uk/~jnm/book/ltsa-v2/index.html.
[15]
J. Magee, and J. Kramer. Concurrency: State models & java programs. Wiley publisher, April 1999.
[16]
N. Medvidovic, and R. Taylor. A Classification and Comparison Framework for Software Architecture Description Languages. In IEEE Trans. on SE, vol. 26, n. 1 Jan 2000.
[17]
H. Muccini, A. Bertolino, and P. Inverardi. Using Software Architecture for Code Testing. In IEEE Transactions on Software Engineering, vol. 30, n. 3, Mar 2004, pp. 160--171.
[18]
H. Muccini, M. Dias, D. Richardson. Systematic Testing of Software Architectures in the C2 style. In Proc. Fundamental Approaches to Software Engineering (FASE '04), ETAPS 2004, March 2004.
[19]
P. Oreizy, N. Medvidovic, and R. Taylor. Architecture-Based Runtime Software Evolution. In Proc. Int. Conf. on Software Engineering, ICSE 98, Kyoto, Japan, April 1998.
[20]
D. E. Perry, and A. L. Wolf. Foundations for the Study of Software Architectures. In SIGSOFT Software Engineering Notes 17, 4 (October 1992): 40--52.
[21]
Y. Wu, M. H. Chen, and H. M. Kao. Regression Testing of Object-Oriented Programs. In Proc. Int. Symposium on Software Reliability, 1999.
[22]
Y. Wu, D. Pan, and M. H. Chen. Techniques of Maintaining Evolving Component-Based Software. In IEEE Proc. Int. Conf. on Software Maintenance, 2000.

Cited By

View all
  • (2016)Improving Testing in an Enterprise SOA with an Architecture-Based Approach2016 13th Working IEEE/IFIP Conference on Software Architecture (WICSA)10.1109/WICSA.2016.24(231-240)Online publication date: Apr-2016
  • (2013)Path coverage assessment for software architecture testingIEEE Conference Anthology10.1109/ANTHOLOGY.2013.6784979(1-5)Online publication date: Jan-2013
  • (2013)On the relation of software architecture testing criteria in the C2 styleIEEE Conference Anthology10.1109/ANTHOLOGY.2013.6784973(1-5)Online publication date: Jan-2013
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
WADS '05: Proceedings of the 2005 workshop on Architecting dependable systems
May 2005
84 pages
ISBN:1595931244
DOI:10.1145/1083217
  • cover image ACM SIGSOFT Software Engineering Notes
    ACM SIGSOFT Software Engineering Notes  Volume 30, Issue 4
    July 2005
    1514 pages
    ISSN:0163-5948
    DOI:10.1145/1082983
    Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 May 2005

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. architecture-based testing and analysis
  2. dependable systems
  3. regression testing (RT)
  4. software architecture (SA)

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)5
  • Downloads (Last 6 weeks)0
Reflects downloads up to 09 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2016)Improving Testing in an Enterprise SOA with an Architecture-Based Approach2016 13th Working IEEE/IFIP Conference on Software Architecture (WICSA)10.1109/WICSA.2016.24(231-240)Online publication date: Apr-2016
  • (2013)Path coverage assessment for software architecture testingIEEE Conference Anthology10.1109/ANTHOLOGY.2013.6784979(1-5)Online publication date: Jan-2013
  • (2013)On the relation of software architecture testing criteria in the C2 styleIEEE Conference Anthology10.1109/ANTHOLOGY.2013.6784973(1-5)Online publication date: Jan-2013
  • (2012)A Testing Frameworks for Mobile Embedded Systems Using MDASoftware Engineering Research,Management and Applications 201110.1007/978-3-642-23202-2_6(77-94)Online publication date: 2012
  • (2011)Analysis of model based regression testing approachesProceedings of the 10th WSEAS international conference on communications, electrical & computer engineering, and 9th WSEAS international conference on Applied electromagnetics, wireless and optical communications10.5555/1989676.1989689(65-70)Online publication date: 24-Mar-2011
  • (2011)A systematic mapping study of software product lines testingInformation and Software Technology10.1016/j.infsof.2010.12.00353:5(407-423)Online publication date: 1-May-2011
  • (2010)Model Based Testing Using Software ArchitectureProceedings of the 2010 Seventh International Conference on Information Technology: New Generations10.1109/ITNG.2010.122(188-193)Online publication date: 12-Apr-2010
  • (2009)Model-based testing and the UML testing profileSemantics and algebraic specification10.5555/1809296.1809312(315-328)Online publication date: 1-Jan-2009
  • (2009)Automating regression test selection based on UML designsInformation and Software Technology10.1016/j.infsof.2008.09.01051:1(16-30)Online publication date: 1-Jan-2009
  • (2009)Model-Based Testing and the UML Testing ProfileSemantics and Algebraic Specification10.1007/978-3-642-04164-8_16(315-328)Online publication date: 2009
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media