skip to main content
10.1145/1291535.1291547acmconferencesArticle/Chapter ViewAbstractPublication PagesicseConference Proceedingsconference-collections
Article

Test purpose generation in an industrial application

Published: 09 July 2007 Publication History

Abstract

Nowadays test engineers use various strategies for the design of test cases. Among others, test cases are designed on basis of structural coverage criteria or test cases are related to specific fault models. In this paper we evaluate these two techniques for test purpose design. We present a heuristic algorithm for the extraction of test cases from TGV's output, i.e., the test process. We discuss the problem of overlapping test purposes and illustrate improvements in terms of test execution time and in terms of number of test cases when minimizing this overlap. Furthermore, we present different strategies for the generation of fault-based test purposes. For our evaluation we apply the presented techniques to a Session Initiation Protocol (SIP) Registrar specification. All extracted test cases are executed against a commercial and an open source implementation of such a SIP Registrar.

References

[1]
B. K. Aichernig and C. C. Delgado. From faults via test purposes to test cases: On the fault-based testing of concurrent systems. In FASE, volume 3922 of LNCS, pages 324--338. Springer, 2006.
[2]
B. K. Aichernig, B. Peischl, M. Weiglhofer, and F. Wotawa. Protocol conformance testing a SIP registrar: an industrial application of formal methods. In 5th IEEE International Conference on Software Engineering and Formal Methods, 2007. To appear.
[3]
L. du Bousquet, S. Ramangalahy, S. Simon, C. Viho, A. Belinfante, and R. G. de Vries. Formal test automation: The conference protocol with TGV/TorX. In TestCom, volume 176 of IFIP Conference Proceedings, pages 221--228, 2000.
[4]
J.-C. Fernandez, C. Jard, T. Jéron, and C. Viho. An experiment in automatic generation of test suites for protocols with verification technology. Science of Computer Programming, 29(1--2):123--146, 1997.
[5]
J. Franks, P. Hallam-Baker, J. Hostetler, S. Lawrence, P. Leach, A. Luotonen, and L. Stewart. HTTP Authentication: Basic and Digest Access Authentication. RCF 2617, IETF, 1999.
[6]
H. Garavel, F. Lang, and R. Mateescu. An overview of CADP 2001. European Association for Software Science and Technology Newsletter, 4:13--24, 2002.
[7]
J. Grabowski, D. Hogrefe, and R. Nahm. Test case generation with test purpose specification by MSC's. In SDL'93, the 6th SDL Forum, pages 253--266. Elsevier Science, 1993.
[8]
W. Grieskamp, N. Tillmann, C. Campbell, W. Schulte, and M. Veanes. Action machines --- towards a framework for model composition, exploration and conformance testing based on symbolic computation. In QSIC, pages 72--79, 2005.
[9]
ISO. ISO 8807: Information processing systems - open systems interconnection - LOTOS - a formal description technique based on the temporal ordering of observational behaviour, 1989.
[10]
C. Jard and T. Jéron. TGV: theory, principles and algorithms. International Journal on Software Tools for Technology Transfer (STTT), 7(4):297--315, 2005.
[11]
H. Kahlouche, C. Viho, and M. Zendri. An industrial experiment in automatic generation of executable test suites for a cache coherency protocol. In IWTCS, pages 211--226, 1998.
[12]
G. J. Myers. The Art of Software Testing. John Wiley & Sons, Inc., 1979.
[13]
J. Rosenberg, H. Schulzrinne, G. Camarillo, A. Johnston, J. Peterson, R. Sparks, M. Handley, and E. Schooler. SIP: Session initiation protocol. RFC 3261, IETF, 2002.
[14]
J. Tretmans. Test generation with inputs, outputs and repetitive quiescence. Software - Concepts and Tools, 17(3):103--120, 1996.
[15]
J. Tretmans and E. Brinksma. TorX: Automated model based testing. In A. Hartman and K. Dussa-Zieger, editors, Proceedings of the First European Conference on Model-Driven Software Engineering, pages 13--25, Nurnburg, Germany, 2003.
[16]
M. Weiglhofer. A LOTOS formalization of SIP. Technical Report SNA-TR-2006-1P1, Competence Network Softnet Austria, December 2006.
[17]
M. Weiglhofer. Conformance testing of a session initiation protocol server. Technical Report SNA-TR-2006-1P2, Competence Network Softnet Austria, To appear.

Cited By

View all
  • (2019)A Testing Perspective on Algebraic, Denotational, and Operational SemanticsUnifying Theories of Programming10.1007/978-3-030-31038-7_2(22-38)Online publication date: 23-Sep-2019
  • (2008)Improving Fault-based Conformance TestingElectronic Notes in Theoretical Computer Science (ENTCS)10.1016/j.entcs.2008.11.006220:1(63-77)Online publication date: 1-Dec-2008
  • (2008)Applying Model-Based Testing to HTML Rendering Engines --- A Case StudyProceedings of the 20th IFIP TC 6/WG 6.1 international conference on Testing of Software and Communicating Systems: 8th International Workshop10.1007/978-3-540-68524-1_18(250-265)Online publication date: 10-Jun-2008

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
A-MOST '07: Proceedings of the 3rd international workshop on Advances in model-based testing
July 2007
127 pages
ISBN:9781595938503
DOI:10.1145/1291535
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 July 2007

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. fault-based test purposes
  2. model-based testing
  3. protocol conformance testing
  4. test purpose design

Qualifiers

  • Article

Conference

ISSTA07
Sponsor:

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 19 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2019)A Testing Perspective on Algebraic, Denotational, and Operational SemanticsUnifying Theories of Programming10.1007/978-3-030-31038-7_2(22-38)Online publication date: 23-Sep-2019
  • (2008)Improving Fault-based Conformance TestingElectronic Notes in Theoretical Computer Science (ENTCS)10.1016/j.entcs.2008.11.006220:1(63-77)Online publication date: 1-Dec-2008
  • (2008)Applying Model-Based Testing to HTML Rendering Engines --- A Case StudyProceedings of the 20th IFIP TC 6/WG 6.1 international conference on Testing of Software and Communicating Systems: 8th International Workshop10.1007/978-3-540-68524-1_18(250-265)Online publication date: 10-Jun-2008

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media