article

Free access

Testing object-oriented industrial software without precise oracles or results

Authors:

Francis C. M. Lau,

Peter C. K. Liu,

Colin K. F. LukAuthors Info & Claims

Communications of the ACM, Volume 50, Issue 8

Pages 78 - 85

https://doi.org/10.1145/1278201.1278210

Published: 01 August 2007 Publication History

All formats PDF

Abstract

TACCLE tests an automated assembly system in which the expected outcomes cannot be precisely defined and the actual results cannot be directly observed.

References

[1]

Andrews, J.H. and Zhang, Y. General test result checking with log file analysis. IEEE Transactions on Software Engineering 29, 7 (July 2003), 634--648.

Digital Library

[2]

Beizer, B. Software Testing Techniques. Van Nostrand Reinhold, New York, 1990.

Digital Library

[3]

Brand, D. and Zafiropulo, P. On communicating finite-state machines. Journal of the ACM 30, 2 (Apr. 1983), 323--342.

Digital Library

[4]

Chen, H.Y., Tse, T.H., and Chen, T.Y. TACCLE: A methodology for object-oriented software testing at the class and cluster levels. ACM Transactions on Software Engineering and Methodology 10, 1 (Jan. 2001), 56--109.

Digital Library

[5]

Fetzer, C., Felber, P., and Hogstedt, K. Automatic detection and masking of nonatomic exception handling. IEEE Transactions on Software Engineering 30, 8 (Aug. 2004), 547--560.

Digital Library

[6]

Goguen, J.A. and Malcolm, G., Eds. Software Engineering with OBJ: Algebraic Specification in Action. Kluwer Academic Publishers, Boston, 2000.

[7]

Milner, R. Communication and Concurrency. Prentice Hall International Series in Computer Science. Prentice Hall, Hemel Hempstead, Hertfordshire, U.K., 1989.

Digital Library

[8]

National Institute of Standards and Technology. The Economic Impacts of Inadequate Infrastructure for Software Testing. Final Report. Gaithersburg, MD, 2002; www.nist.gov/director/progofc/report02-3.pdf.

[9]

Peters, D.K. and Parnas, D.L. Using test oracles generated from program documentation. IEEE Transactions on Software Engineering 24, 3 (Mar. 1998), 161--173.

Digital Library

[10]

van Gabbeek, R.J. and Weijland, W.P. Branching time and abstraction in bisimulation semantics. Journal of the ACM 43, 3 (May 1996), 555--600.

Digital Library

[11]

Weyuker, E.J. On testing non-testable programs. The Computer Journal 25, 4 (Nov. 1982), 465--470.

[12]

Briand, L., di Penta, M., and Labiche, Y. Assessing and improving state-based class testing: A series of experiments. IEEE Transactions on Software Engineering 30, 11 (Nov. 2004), 770--793.

Digital Library

[13]

Chen, H.Y., Tse, T.H., Chan, F.T., and Chen, T. Y. In black and white: An integrated approach to class-level testing of object-oriented programs. ACM Transactions on Software Engineering and Methodology 7, 3 (July 1998), 250--295.

Digital Library

[14]

Doong, R.-K. and Frankl, P.G. The ASTOOT approach to testing object-oriented programs. ACM Transactions on Software Engineering and Methodology 3, 2 (Apr. 1994), 101--130.

Digital Library

[15]

Pezze, M. and Young, M. Testing object-oriented software. In Proceedings of the 26th International Conference on Software Engineering (ICSE 2004) (Edinburgh, U.K.). IEEE Computer Society Press, Los Alamitos, CA, 2004, 739--740.

Digital Library

Cited By

Yin YRuan JLi YLi YPan Z(2021)Syntax‐based metamorphic relation prediction via the bagging frameworkExpert Systems10.1111/exsy.1290239:6Online publication date: 15-Dec-2021
https://doi.org/10.1111/exsy.12902
Patel KHierons R(2018)A mapping study on testing non-testable systemsSoftware Quality Journal10.1007/s11219-017-9392-426:4(1373-1413)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1007/s11219-017-9392-4
Poon CWong TYu YLee VTang C(2016)Toward More Robust Automatic Analysis of Student Program Outputs for Assessment and Learning2016 IEEE 40th Annual Computer Software and Applications Conference (COMPSAC)10.1109/COMPSAC.2016.208(780-785)Online publication date: Jun-2016
https://doi.org/10.1109/COMPSAC.2016.208
Show More Cited By

Index Terms

Testing object-oriented industrial software without precise oracles or results

Recommendations

Testing Object-Oriented Software
Fault-based testing without the need of oracles
Abstract
There are two fundamental limitations in software testing, known as the reliable test set problem and the oracle problem. Fault-based testing is an attempt by Morell to alleviate the reliable test set problem. In this paper, we propose to enhance ...
Testing object-oriented software (abstract)
OOPSLA '92: Addendum to the proceedings on Object-oriented programming systems, languages, and applications (Addendum)

Testing of object-oriented software is just as important as testing non-object-oriented software, but the process is fundamentally different because of such factors as information hiding, encapsulation, and inheritance. This tutorial teaches you the ...

Comments

Information & Contributors

Information

Published In

cover image Communications of the ACM

Communications of the ACM Volume 50, Issue 8

August 2007

94 pages

ISSN:0001-0782

EISSN:1557-7317

DOI:10.1145/1278201

Issue’s Table of Contents

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2007

Published in CACM Volume 50, Issue 8

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
1,325
Total Downloads

Downloads (Last 12 months)189
Downloads (Last 6 weeks)50

Reflects downloads up to 18 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yin YRuan JLi YLi YPan Z(2021)Syntax‐based metamorphic relation prediction via the bagging frameworkExpert Systems10.1111/exsy.1290239:6Online publication date: 15-Dec-2021
https://doi.org/10.1111/exsy.12902
Patel KHierons R(2018)A mapping study on testing non-testable systemsSoftware Quality Journal10.1007/s11219-017-9392-426:4(1373-1413)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1007/s11219-017-9392-4
Poon CWong TYu YLee VTang C(2016)Toward More Robust Automatic Analysis of Student Program Outputs for Assessment and Learning2016 IEEE 40th Annual Computer Software and Applications Conference (COMPSAC)10.1109/COMPSAC.2016.208(780-785)Online publication date: Jun-2016
https://doi.org/10.1109/COMPSAC.2016.208
Chan WTse T(2013)Oracles Are Hardly Attain'd, and Hardly UnderstoodProceedings of the 2013 13th International Conference on Quality Software10.1109/QSIC.2013.16(245-252)Online publication date: 29-Jul-2013
https://dl.acm.org/doi/10.1109/QSIC.2013.16
Chen TTse TZhou Z(2011)Semi-ProvingIEEE Transactions on Software Engineering10.1109/TSE.2010.2337:1(109-125)Online publication date: 1-Jan-2011
https://dl.acm.org/doi/10.1109/TSE.2010.23
DONG GNIE CXU B(2009)Effectively Metamorphic Testing Based on Program Path AnalysisChinese Journal of Computers10.3724/SP.J.1016.2009.0100232:5(1002-1013)Online publication date: 11-Aug-2009
https://doi.org/10.3724/SP.J.1016.2009.01002
Chen HTse T(2009)Automatic Generation of Normal Forms for Testing Object-Oriented SoftwareProceedings of the 2009 Ninth International Conference on Quality Software10.1109/QSIC.2009.22(108-116)Online publication date: 24-Aug-2009
https://dl.acm.org/doi/10.1109/QSIC.2009.22
Gaudel MLe Gall P(2008)Testing data types implementations from algebraic specificationsFormal methods and testing10.5555/1806209.1806216(209-239)Online publication date: 1-Jan-2008
https://dl.acm.org/doi/10.5555/1806209.1806216
Baharom SShukur Z(2008)Module documentation based testing using Grey-Box approach2008 International Symposium on Information Technology10.1109/ITSIM.2008.4631651(1-6)Online publication date: Aug-2008
https://doi.org/10.1109/ITSIM.2008.4631651
Chen HTan LTse T(2008)A Scheme to Aid Construction of Left-Hand Sides of Axioms in Algebraic Specifications for Object-Oriented Program TestingProceedings of the 2008 International Conference on Computer Science and Software Engineering - Volume 0210.1109/CSSE.2008.600(747-750)Online publication date: 12-Dec-2008
https://dl.acm.org/doi/10.1109/CSSE.2008.600
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Magazine Site

View this article on the magazine site (external)

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Figures

Tables

Media

View Issue’s Table of Contents