Bryan Robbins
Jeff Carver
ABSTRACT
The following study investigated cognitive factors involved in applying the Perspective-Based Reading (PBR) technique for defect detection in software inspections. Using the protocol analysis technique from cognitive science, the authors coded concurrent verbal reports from novice reviewers and used frequency-based analysis to consider existing research on cognition in software inspections from within a cognitive framework. The current coding scheme was able to describe over 98% of the cognitive activities reported during inspection at a level of detail capable of validating multiple hypotheses from literature. A number of threats to validity are identified for the protocol analysis method and the parameters of the current experiment. The authors conclude that protocol analysis is a useful tool for analyzing cognitively intense software engineering tasks such as software inspections.
- R.C. Atkinson and R.M. Shiffrin, "Human Memory: A Proposed System and its Control Processes", Psychology of Learning and Motivation II , Edited by K. W. Spence and J. T. Spence, Academic Press, New York, NY, 1968, 89-195.Google Scholar
- V.R. Basili, S. Green, O. Laitenberger, F. Lanubile, F. Shull, S. Sørumgård, and M.V. Zelkowitz, "The Empirical Investigation of Perspective-Based Reading", Empirical Software Engineering . 1(2), Springer, 1996, pp.133-164.Google Scholar
- Carver, J.C., The Impact of Background and Experience on Software Inspections , Doctoral Thesis, UMI Order Number: AAI3094462., University of Maryland at College Park, 2003. Google Scholar
- J.K. Chaar, M.J. Halliday, I.S. Bhandari, and R. Chillarege, "In-Process Evaluation for Software Inspection and Test", IEEE Transactions on Software Engineering, 19(11), 1993, pp. 1055-1070. Google Scholar
- Ericsson, K. A. and H. A. Simon, Verbal Reports as Data , MIT Press, Cambridge, MA, 1993.Google Scholar
- L. He and J. Carver, "PBR vs. Checklist: A Replication in the N-Fold Inspection Context", in Proceedings of the 2006 ACM/IEEE international Symposium on Empirical Software Engineering (Rio de Janeiro, Brazil, September 21-22, 2006). ACM, New York, NY, 2006, pp. 95-104. Google Scholar
- D. C. Howell, Statistical Methods for Psychology , 5th Edition, Thomson/Wadsworth, Toronto, CA, 2005.Google Scholar
- B. A. Kitchenham, T. Dybå, and M. Jørgensen, "Evidence-Based Software Engineering", in Proceedings of the 26th International Conference on Software Engineering (Edinburgh, Scotland, May 23-28 2004), IEEE, 2004, pp. 273-281. Google Scholar
- O. Laitenberger, K. El Emam, and T.G. Harbich, "An Internally Replicated Quasi-Experimental Comparison of Checklist and Perspective-Based Reading of Code Documents", IEEE Transactions on Software Engineering , 27(5), IEEE, 2001, pp. 387-421. Google Scholar
- J.C. Maldonado, J. Carver, F. Shull, S. Fabbri, Dória, E., L. Martimiano, M. Mendonça, and V. Basili, "Perspective-Based Reading: A Replicated Experiment Focused on Individual Reviewer Effectiveness", Empirical Software Engineering , 11(1), Springer, 2006, pp. 119-142. Google Scholar
- A. Porter and L.G. Votta, "An Experiment to Assess Different Defect Detection Methods for Software Requirements Inspections", in Proceedings of the 16th International Conference on Software Engineering , (Sorrento, Italy, May 16-21, 1994), IEEE, 1994, pp 103- 112. Google Scholar
- A.A. Porter, L.G. Votta, and V.R. Basili, "Comparing Detection Methods for Software Requirements Inspections: A Replicated Experiment", IEEE Transactions on Software Engineering, 21(6), IEEE, 1995, pp. 563-575. Google Scholar
- B. Regnell, P. Runeson, and T. Thelin, "Are the Perspectives Really Different? - Further Experimentation on Scenario-Based Reading of Requirements", Empirical Software Engineering , 5(4), Springer, 2000, pp. 331-356. Google Scholar
- F. Shull, I. Rus, and V. Basili, "How Perspective-Based Reading Can Improve Requirements Inspections", Computer , 33(7), IEEE, pp. 73-79. Google Scholar
Index Terms
- Cognitive factors in perspective-based reading (PBR): A protocol analysis study
Recommendations
PBR vs. checklist: a replication in the n-fold inspection context
ISESE '06: Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineeringInspection is considered a powerful method to check software documents for defects. Many published work shows that inspections in requirements specification phase are particularly effective and efficient. Perspective-Based Reading (PBR) is one of the ...
Perspective-Based Reading: A Replicated Experiment Focused on Individual Reviewer Effectiveness
This paper describes a replication conducted to compare the effectiveness of inspectors using Perspective Based Reading (PBR) to the effectiveness of inspectors using a checklist. The goal of this replication was to better understand the complementary ...
An Experimental Comparison of Checklist-Based Reading and Perspective-Based Reading for UML Design Document Inspection
ISESE '02: Proceedings of the 2002 International Symposium on Empirical Software EngineeringThis paper describes an experimental comparison of two reading techniques, namely Checklist-based reading (CBR) and Perspective-based reading (PBR) for Object-Oriented (OO) design inspection. Software inspection is an effective approach to detect ...
Comments