skip to main content
10.1145/1526709.1526830acmconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article

Test case prioritization for regression testing of service-oriented business applications

Published: 20 April 2009 Publication History

Abstract

Regression testing assures the quality of modified service-oriented business applications against unintended changes. However, a typical regression test suite is large in size. Earlier execution of those test cases that may detect failures is attractive. Many existing prioritization techniques order test cases according to their respective coverage of program statements in a previous version of the application. On the other hand, industrial service-oriented business applications are typically written in orchestration languages such as WS-BPEL and integrated with workflow steps and web services via XPath and WSDL. Faults in these artifacts may cause the application to extract wrong data from messages, leading to failures in service compositions. Surprisingly, current regression testing research hardly considers these artifacts. We propose a multilevel coverage model to capture the business process, XPath, and WSDL from the perspective of regression testing. We develop a family of test case prioritization techniques atop the model. Empirical results show that our techniques can achieve significantly higher rates of fault detection than existing techniques.

References

[1]
BPWS4J: a Platform for Creating and Executing BPEL4WS Processes, Version 2.1. IBM, 2002. Available at http://www.alphaworks.ibm.com/tech/bpws4j.
[2]
W. K. Chan, S. C. Cheung, and K. R. P. H. Leung. A metamorphic testing approach for online testing of service-oriented software applications. International Journal of Web Services Research, 4 (2): 60--80, 2007.
[3]
H. Y. Chen, T. H. Tse, and T. Y. Chen. TACCLE: a methodology for object-oriented software testing at the class and cluster levels. ACM Transactions on Software Engineering and Methodology, 10 (1): 56--109, 2001.
[4]
H. Do, G. Rothermel, and A. Kinneer. Empirical studies of test case prioritization in a JUnit testing environment. In Proceedings of the 15th International Symposium on Software Reliability Engineering (ISSRE 2004), pages 113--124. IEEE Computer Society Press, Los Alamitos, CA, 2004.
[5]
S. G. Elbaum, A. G. Malishevsky, and G. Rothermel. Test case prioritization: a family of empirical studies. IEEE Transactions on Software Engineering, 28 (2): 159--182, 2002.
[6]
S.-S. Hou, L. Zhang, T. Xie, and J.-S. Sun. Quota-constrained test-case prioritization for regression testing of service-centric systems. In Proceedings of the IEEE International Conference on Software Maintenance (ICSM 2008), pages 257--266. IEEE Computer Society Press, Los Alamitos, CA, 2008.
[7]
M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments on the effectiveness of dataflow- and controlflow-based test adequacy criteria. In Proceedings of the 16th International Conference on Software Engineering (ICSE 1994), pages 191--200. IEEE Computer Society Press, Los Alamitos, CA, 1994.
[8]
H. K. N. Leung and L. J. White. Insights into regression testing. In Proceedings of the IEEE International Conference on Software Maintenance (ICSM 1989), pages 60--69. IEEE Computer Society Press, Los Alamitos, CA, 1989.
[9]
Z. Li, M. Harman, and R. M. Hierons. Search algorithms for regression test case prioritization. IEEE Transactions on Software Engineering, 33 (4): 225--237, 2007.
[10]
E. Martin, S. Basu, and T. Xie. Automated testing and response analysis of Web services. In Proceedings of the IEEE International Conference on Web Services (ICWS 2007), pages 647--654. IEEE Computer Society Press, Los Alamitos, CA, 2007.
[11]
L. Mei, W. K. Chan, and T. H. Tse. An adaptive service selection approach to service composition. In Proceedings of the IEEE International Conference on Web Services (ICWS 2008), pages 70--77. IEEE Computer Society Press, Los Alamitos, CA, 2008.
[12]
L. Mei, W. K. Chan, and T. H. Tse. Data flow testing of service-oriented workflow applications. In Proceedings of the 30th International Conference on Software Engineering (ICSE 2008), pages 371--380. ACM Press, New York, NY, 2008.
[13]
G. Miklau and D. Suciu. Containment and equivalence for a fragment of XPath. Journal of the ACM, 51 (1): 2--45, 2004.
[14]
O. Moser, F. Rosenberg, and S. Dustdar. Non--intrusive monitoring and service adaptation for WS-BPEL. In Proceedings of the 17th International Conference on World Wide Web (WWW 2008), pages 815--824. ACM Press, New York, NY, 2008.
[15]
A. K. Onoma, W.-T. Tsai, M. Poonawala, and H. Suganuma. Regression testing in an industrial environment. Communications of the ACM, 41 (5): 81--86, 1998.
[16]
Oracle BPEL Process Manager. Oracle Technology Network. Available at http://www.oracle.com/technology/products/ias/bpel/. Last access February 8, 2009.
[17]
S. Rapps and E. J. Weyuker. Selecting software test data using data flow information. IEEE Transactions on Software Engineering, SE--11 (4): 367--375, 1985.
[18]
G. Rothermel and M. J. Harrold. Analyzing regression test selection techniques. IEEE Transactions on Software Engineering, 22 (8): 529--551, 1996.
[19]
G. Rothermel, R. H. Untch, C. Chu, and M. J. Harrold. Prioritizing test cases for regression testing. IEEE Transactions on Software Engineering, 27 (10): 929--948, 2001.
[20]
M. E. Ruth and S. Tu. Towards automating regression test selection for Web services. In Proceedings of the 16th International Conference on World Wide Web (WWW 2007), pages 1265--1266. ACM Press, New York, NY, 2007.
[21]
Travel handling. BPEL Repository. IBM, 2006 Available at http://www.alphaworks.ibm.com/tech/bpelrepository.
[22]
Web Services Business Process Execution Language Version 2.0. OSAIS. Available at http://www.oasis-open.org/committees/wsbpel/. Last access February 8, 2009.
[23]
Web Services Description Language (WSDL) 1.1. W3C, 2001. Available at http://www.w3.org/TR/wsdl.
[24]
Web Services Invocation Framework: DSL Provider Sample Application. Apache Software Foundation, 2006. Available at http://ws.apache.org/wsif/wsif_samples/index.html.
[25]
XML Path Language (XPath) Recommendation. W3C, 2007. Available at http://www.w3.org/TR/xpath20/.
[26]
C. Ye, S. C. Cheung, and W. K. Chan. Publishing and composition of atomicity-equivalent services for B2B collaboration. In Proceedings of the 28th International Conference on Software Engineering (ICSE 2006), pages 351--360. ACM Press, New York, NY, 2006.

Cited By

View all
  • (2023)Modification-Impact based Test Prioritization for Process-Driven Applications2023 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)10.1109/ICSTW58534.2023.00068(365-372)Online publication date: Apr-2023
  • (2023)A Systematic Literature Review on Test Case Prioritization TechniquesAgile Software Development10.1002/9781119896838.ch7(101-159)Online publication date: 8-Feb-2023
  • (2021)AGA: An Accelerated Greedy Additional Algorithm for Test Case PrioritizationIEEE Transactions on Software Engineering10.1109/TSE.2021.3137929(1-1)Online publication date: 2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
WWW '09: Proceedings of the 18th international conference on World wide web
April 2009
1280 pages
ISBN:9781605584874
DOI:10.1145/1526709

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 April 2009

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. WSDL
  2. XPath
  3. service orientation
  4. test case prioritization

Qualifiers

  • Research-article

Conference

WWW '09
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)14
  • Downloads (Last 6 weeks)0
Reflects downloads up to 18 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Modification-Impact based Test Prioritization for Process-Driven Applications2023 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)10.1109/ICSTW58534.2023.00068(365-372)Online publication date: Apr-2023
  • (2023)A Systematic Literature Review on Test Case Prioritization TechniquesAgile Software Development10.1002/9781119896838.ch7(101-159)Online publication date: 8-Feb-2023
  • (2021)AGA: An Accelerated Greedy Additional Algorithm for Test Case PrioritizationIEEE Transactions on Software Engineering10.1109/TSE.2021.3137929(1-1)Online publication date: 2021
  • (2020)Taming behavioral backward incompatibilities via cross-project testing and analysisProceedings of the ACM/IEEE 42nd International Conference on Software Engineering10.1145/3377811.3380436(112-124)Online publication date: 27-Jun-2020
  • (2020)Environment-Aware and Human-Centric Software Testing Framework for Cyber-Physical SystemsCurrent Trends in Web Engineering10.1007/978-3-030-51253-8_11(104-115)Online publication date: 30-Jun-2020
  • (2017)Hybrid firefly algorithm based regression testcase prioritisationInternational Journal of Business Intelligence and Data Mining10.5555/3159246.315924812:4(340-357)Online publication date: 1-Jan-2017
  • (2017)Learning to prioritize test programs for compiler testingProceedings of the 39th International Conference on Software Engineering10.1109/ICSE.2017.70(700-711)Online publication date: 20-May-2017
  • (2017)Optimal control based regression test selection for service-oriented workflow applicationsJournal of Systems and Software10.1016/j.jss.2016.06.065124:C(274-288)Online publication date: 1-Feb-2017
  • (2017)Prioritizing MCDC test cases by spectral analysis of Boolean functionsSoftware Testing, Verification and Reliability10.1002/stvr.164127:7Online publication date: Aug-2017
  • (2016)Automated regression testing of BPMN 2.0 processes: a capture and replay framework for continuous deliveryACM SIGPLAN Notices10.1145/3093335.299325752:3(178-189)Online publication date: 20-Oct-2016
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media