An analysis of patterns of debugging among novice computer science students

ABSTRACT

The process by which students learn to program is a major issue in computer science educational research. Programming is a fundamental part of the computer science curriculum, but one which is often problematic. It seems to be difficult to find an effective method of teaching that is suitable for all students. In this research we tried to gain insights into ways of improving our teaching by a careful examination of students' mistakes. The compiler errors that were generated by their programs together with the pattern that was observed in their debugging activities formed the basis of this research. We discovered that many students with a good understanding of programming do not acquire the skills to debug programs effectively, and this is a major impediment to their producing working code of any complexity. Skill at debugging seems to increase a programmer's confidence and we suggest that more emphasis be placed on debugging skills in the teaching of programming.

REFERENCES

• 1: Curtis Cook , Margaret Burnett , Derrick Boom, A bug's eye view of immediate visual feedback in direct-manipulation programming systems, Papers presented at the seventh workshop on Empirical studies of programmers, p.20-41, October 1997, Alexandria, Virginia, United States [doi>10.1145/266399.266403]
• 2: Coull, N., Duncan I., Archibald J., and Lund G. Helping Novice Programmers Interpret Compiler Error Messages. 4th Annual LTSN-ICS Conference. National University of Ireland, Galway. (August, 2003). 26--28.
• 3: N. Cunniff , R. P. Taylor , J. B. Black, Does programming language affect the type of conceptual bugs in beginners' programs? A comparison of FPL and Pascal, Proceedings of the SIGCHI conference on Human factors in computing systems, p.175-182, April 13-17, 1986, Boston, Massachusetts, United States
• 4: Du-Boulay, B. Some Difficulties of Learning To Program. In: (Ed.). Studying the Novice Programmer, 1989. 283--299.
• 5: M. Ducassé , A.-M. Emde, A review of automated debugging systems: knowledge, strategies and techniques, Proceedings of the 10th international conference on Software engineering, p.162-171, April 11-15, 1988, Singapore
• 6: Gould, J. D. Some psychological evidence on how people debug computer programs. International Journal of Man-Machine Studies, 7, 1, (January 1975). 151--182.
• 7: Green, T., and Petre M. Usability Analysis of Visual Programming Environments: A 'Cognitive Dimensions' Framework. Journal of Visual Languages and Computing, 7, 2, (June 1996). 131--174.
• 8: L. Gugerty , G. Olson, Debugging by skilled and novice programmers, Proceedings of the SIGCHI conference on Human factors in computing systems, p.171-174, April 13-17, 1986, Boston, Massachusetts, United States
• 9: Leo Gugerty , Gary M. Olson, Comprehension differences in debugging by skilled and novice programmers, Papers presented at the first workshop on empirical studies of programmers on Empirical studies of programmers, p.13-27, June 1986, Washington, D.C., United States
• 10: Colin Higgins , Pavlos Symeonidis , Athanasios Tsintsifas, The marking system for CourseMaster, Proceedings of the 7th annual conference on Innovation and technology in computer science education, June 24-28, 2002, Aarhus, Denmark
• 11: Maria Hristova , Ananya Misra , Megan Rutter , Rebecca Mercuri, Identifying and correcting Java programming errors for introductory computer science students, Proceedings of the 34th SIGCSE technical symposium on Computer science education, February 19-23, 2003, Reno, Navada, USA
• 12: Takashi Ishio , Shinji Kusumoto , Katsuro Inoue, Program Slicing Tool for Effective Software Evolution Using Aspect-Oriented Technique, Proceedings of the 6th International Workshop on Principles of Software Evolution, p.3, September 01-02, 2003
• 13: Jcreator. Java IDE. http://www.jcreator.com/. 2003
• 14: Jikes. IBM- developerworks - open source software.(http://oss.software.ibm.com/developerworks/opensource/jikes/index.shtml). Last Accessed on October,2003
• 15: Johnson, L., Soloway E., Cutler B., and Draper S. Bug Catalogue: I, Technical Report No. 286. Yale University, Department of Computer Science. New Haven. 1983
• 16: Pea, R. D. Language-independent conceptual bugs in novice programming. Journal of Educational Computing Research, 2, 1, 1986. 25--36.
• 17: T. J. Robertson , Shrinu Prabhakararao , Margaret Burnett , Curtis Cook , Joseph R. Ruthruff , Laura Beckwith , Amit Phalgune, Impact of interruption style on end-user debugging, Proceedings of the SIGCHI conference on Human factors in computing systems, p.287-294, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985729]
• 18: Pablo Romero , Rudi Lutz , Richard Cox , Benedict du Boulay, Co-Ordination of Multiple External Representations during Java Program Debugging, Proceedings of the IEEE 2002 Symposia on Human Centric Computing Languages and Environments (HCC'02), p.207, September 03-06, 2002
• 19: Spohrer, J., Soloway E., and Pope E. A Goal/Plan analysis of Buggy Pascal Programs. Human Computer Interaction, 1, 1985. 163--207.
• 20: James G. Spohrer , Elliot Soloway, Analyzing the high frequency bugs in novice programs, Papers presented at the first workshop on empirical studies of programmers on Empirical studies of programmers, p.230-251, June 1986, Washington, D.C., United States
• 21: James C. Spohrer , Elliot Soloway, Novice mistakes: are the folk wisdoms correct?, Communications of the ACM, v.29 n.7, p.624-632, July 1986 [doi>10.1145/6138.6145]
• 22: James C. Spohrer , Elliot Soloway , Edgar Pope, Where the bugs are, Proceedings of the SIGCHI conference on Human factors in computing systems, p.47-53, April 1985, San Francisco, California, United States
• 23: Nghi Truong , Paul Roe , Peter Bancroft, Static analysis of students' Java programs, Proceedings of the sixth conference on Australasian computing education, p.317-325, January 01, 2004, Dunedin, New Zealand
• 24: Abdallah Tubaishat, A Knowledge Base for Program Debugging, Proceedings of the ACS/IEEE International Conference on Computer Systems and Applications, p.321, June 25-29, 2001
• 25: Shinji Uchida , Akito Monden , Hajimu Iida , Ken-ichi Matsumoto , Hideo Kudo, A Multiple-View Analysis Model of Debugging Processes, Proceedings of the 2002 International Symposium on Empirical Software Engineering (ISESE'02), p.139, October 03-04, 2002

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.2 Computer and Information Science Education
          Subjects: Computer science education

General Terms:
Experimentation, Languages, Performance

Keywords:
debugging, programming