Early Lessons from Evaluation of Computer Science Teacher Professional Development in Google’s CS4HS Program

Abstract

This article compares self-reported learning gains and experiences of teachers in four professional development courses funded through Google’s 2014 Computer Science for High School program. The courses were designed and taught independently at four universities and started late enough in the year to participate in our pre-post study. Two of the courses used a face-to-face approach, one was online only, and one used a hybrid format. Analyses from 314 pre-surveys and 129 post-surveys indicate CS teachers are far from homogenous, suggesting that some customization may benefit professional development. We also saw a stronger sense of community in the two face-to-face courses. Among the outcomes we measured, teacher concerns (Hall and Hord 1977) were more sensitive to change than our measures of self-efficacy, outcome expectations, readiness, or beliefs. Findings illustrate the variety of CS teacher professional development experiences and the need to study the best ways to scale effective CS teacher education.

References

1. American Institutes for Research. 2017. SEDL Archive: Stages of Concern. Retrieved February 25, 2017 from https://www.sedl.org/cbam/stages_of_concern.html.
2. Elisha Babad. 1996. How high is high inference? Within classroom differences in students’ perceptions of classroom interaction. J. Classroom Interact. 31, 1 (1996), 1--9.
3. Albert Bandura. 1997. Self-Efficacy: The Exercise of Control. Freeman, New York, NY.
4. Tracy Camp. 1997. The incredible shrinking pipeline. Commun. ACM 40, 10 (Oct. 1997), 103--110. DOI:http://dx.doi.org/10.1145/262793.262813
5. Jeanne Century, Michael Lach, Heather King, Sarah Rand, Courtney Heppner, Baker Franke, and Jean Westrick. 2013. Building an operating system for computer science. Retrieved March 23, 2015 from http://outlier.uchicago.edu/computerscience/OS4CS/.
6. Rudolfo Chávez. 1984. The use of high-inference measures to study classroom climates: A review. Rev. Educ. Res. 54, 2, 237--261.
7. Computing Research Association. 2017. Generation CS: Computer Science Undergraduate Enrollments Surge Since 2006. Retrieved from http://cra.org/data/Generation-CS/.
8. Computing Research Association. 2015. Taulbee Survey. Comput. Res. News 28, 5, 19.
9. Computer Science Teachers Association. 2013. CSTA national secondary school computer science survey: Comparison of results from 2005, 2007, 2009, 2011, and 2013 surveys. Retrieved April 25, 2015 from https://csta.acm.org/Research/sub/HighSchoolSurveys.html.
10. Jan Cuny. 2012. Transforming high school computing: A call to action. ACM Inroads Mag. 3, 2, 32--26. DOI:0.1145/2189835.2189848
11. Eden Dahlstrom, J. D. Walker, and Charles Dziuban. 2013. ECAR Study of Undergraduate Students and Information Technology. EDUCAUSE Center for Analysis and Research, Louisville, CO.
12. Joost C. F. De Winter and Dimitra Dodou. 2010. Five-point likert items: T test versus mann-whitney-wilcoxon. Practical Assessment, Research & Evaluation 15, 11, 1--12.
13. École Polytechnique Federale de Lausanne. 2014. MOOCS Annual Report 2012-2014. Retrieved July 6, 2016 from https://documents.epfl.ch/groups/m/mo/moocs/www/MOOCS_Report_2012-14_1006_HD.pdf.
14. Mary English. 2013. The Role of Newly Prepared PBL Teachers’ Motivational Beliefs and Perceptions of School Conditions in Their Project Based Learning Implementation. Unpublished doctoral dissertation. George Mason University, Fairfax, VA.
15. Barbara Ericson. 2016. Detailed data on pass rates, race, and gender for 2016. Retrieved March 20, 2015 from http://home.cc.gatech.edu/ice-gt/556.
16. Barbara Ericson, Mark Guzdial, and Tom McKlin. 2014. Preparing secondary computer science teachers through an iterative development process. In WiPSCE’14 Proceedings of the 9th Workshop in Primary and Secondary Computing Education. ACM, New York, NY, 116--119. DOI:http://dx.doi.org/10.1145/2670757.2670781
17. Sally Fincher and Josh Tenenberg. 2007. Opening the Door of the Computer Science Classroom: The Disciplinary Commons. In Proceedings of the 38th SIGCSE Technical Symposium on Computer Science Education.
18. Catherine O. Fritz, Peter E. Morris, and Jennifer J. Richler. 2012. Effect size estimates: current use, calculations, and interpretation. J. Exp. Psychol. 141, 1, 2.
19. Joanna Goode, Jane Margolis, and Gail Chapman. 2014. Curriculum is not enough: The educational theory and research foundation of the exploring computer science professional development model. In Proceedings of the 45th ACM Technical Symposium on Computer Science Education. ACM, New York, NY, 493--498. DOI:http://dx.doi.org/10.1145/2538862.2538948
20. Google. 2015. Searching for computer science: Access and barriers in U.S. K-12 education. Retrieved October 19, 2015 from http://services.google.com/fh/files/misc/searching-for-computer-science_report.pdf.
21. Google. 2014. Women who choose computer science—what really matters? Retrieved March 23, 2015 from http://tinyurl.com/girlsincs.
22. Jeff Gray, Kathy Haynie, Sheryl Packman, Mary Boehm, Carol Crawford, and Deepa Muralidhar. 2015. A mid-project report on a statewide professional development model for CS principles. In SIGCSE’15 Proceedings of the 46th ACM Technical Symposium on Computer Science Education. ACM, New York, NY, 380--385. DOI:http://dx.doi.org/10.1145/2676723.2677306
23. Gene Hall and Shirley Hord. 1987. Change in Schools: Facilitating the Process. SUNY Press, Albany, NY.
24. Jeff Haywood. 2014. Lessons from learning at scale: learners, technologies and directions. In Learning at Scale Conference.
25. Linda Kekelis, Rebecca Ancheta, and Etta Heber. 2005. Hurdles in the pipeline: Girls and technology careers. Front.: J. Women’s Stud. 26, 1, 99--109. DOI:http://dx.doi.org/10.1353/fro.2005.0013
26. Karen Koellner and Jennifer Jacobs. 2016. Distinguishing models of professional development: The case of an adaptive model’s impact on teachers’ knowledge, instruction, and student achievement. J. Teacher Educ. 66, 1, 51--67.
27. Jane Margolis, Rachel Estrella, Joanna Goode, Jennifer Jellison Holme, and Kim Nao. 2008. Stuck in the Shallow End: Education, Race, and Computing. MIT Press, Cambridge, MA.
28. Tom McConnell, Joyce Parker, Jan Eberhardt, Matthew Koehler, and Mary Lundeberg. 2013. Virtual Professional Learning Communities: Teachers’ Perceptions of Virtual Versus Face-to-Face Professional Development. Journal of Science Education and Technology.
29. Tom McKlin, Jason Freeman, Brian Magerko, and Mike Reilly, M. 2013. Earsketch: Retrospective Student Engagement Survey Lanier High School (March 2013). Retrieved January 27, 2016 from http://earsketch.gatech.edu/wp-content/uploads/2012/11/Lanier-High-School-Retrospective-Student-Engagement-Spring-2013.pdf.
30. Erin Mindell, Karen Brennan, Gwendolyn Britton, Jennifer S. Kay, and Jennifer Rosato. 2014. CS professional development MOOCs. In Proceedings of the SIGCSE'14 Technical Symposium. ACM, New York, NY, 369--370. DOI:http://dx.doi.org/10.1145/2538862.2538872
31. National Science Foundation. 2012. Science and Engineering Indicators 2012. Washington, DC.
32. Lijun Ni, Mark Guzdial, Allison Elliott Tew, Briana Morrison, and Ria Galanos. 2011. Building a community to support HS CS teachers: The disciplinary commons for computing educators. In Proceedings of the 42nd ACM Technical Symposium on Computer Science Education. ACM, New York, NY, 553--558. DOI:http://dx.doi.org/10.1145/1953163.1953319
33. Geoff Norman. 2010. Likert scales, levels of measurement and the “laws” of statistics. Adv. Health Sci. Educ. 15, 5, 625--632.
34. Scott E. Page. 2008. The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools, and Societies. Princeton University Press, Princeton, NJ.
35. S. L. Orpheus, Christopher D. Crutchfield, Guy Haas Harrison, Daniel D. Garcia, Sheila M. Humphreys, Colleen M. Lewis, and Peter Khooshabeh. 2011. Berkeley foundation for opportunities in information technology: A decade of broadening participation. Trans. Comput. Educ. 11, 3, Article 15 (October 2011). DOI:http://dx.doi.org/10.1145/2037276.2037279
36. Laura Perna, Alan Ruby, Robert Boruch, Nicole Wang, Janie Scull, Chad Evans, and Seher Ahmad. 2013. The Life Cycle of a Million MOOC Users. In Proceedings of the MOOC Research Initiative Conference. Arlington, TX.
37. Pat Phillips and Chris Stephenson. 2013. Bugs in the System: Computer Science Teacher Certification in the U.S. ACM, New York, NY.
38. Sue Sentance, Simon Humphreys, and Mark Dorling. 2014. The network of teaching excellence in computer science and master teachers. In WiPSCE’14 Proceedings of the 9th Workshop in Primary and Secondary Computing Education. ACM, New York, NY, 80--88. DOI:http://dx.doi.org/10.1145/2670757.2670789
39. Traci Sitzmann, Katherine Ely, Kenneth Brown, and Kristina Bauer. 2010. Self-assessment of knowledge: A cognitive learning or affective measure? Acad.f Manag. Learn. Educ. 9, 2, 169--191.
40. Lamar Smith. 2015. House Passes Bipartisan STEM Education Act. (February 2015). Retrieved October 19, 2015 from http://lamarsmith.house.gov/media-center/press-releases/house-passes-bipartisan-stem-education-act.
41. Chris Stephenson, Judith Gal-Ezer, Bruria Haberman, and Anita Verno. 2005. The New Educational Imperative: Improving High School Computer Science Education. Computer Science Teachers Association (CSTA), New York, NY.
42. U. S. Census Bureau. 2017. Quickfacts. Retrieved February 25, 2015 from https://www.census.gov/quickfacts/.
43. U. S. Department of Education, Office of Postsecondary Education. 2015. Teacher Shortage Area Nationwide Listing 1991-1991 through 2014-15. Retrieved January 26, 2016 from https://www2.ed.gov/about/offices/list/ope/pol/tsa.pdf.
44. Moshe Y. Vardi. 2012. Will MOOCs destroy academia? Commun. ACM 55, 11, 5.
45. Arto Vihavainen, Matti Luukkainen, and Jaakko Kurhila. 2012. Multi-faceted support for MOOC in programming. In Proceedings of the 13th Annual Conference on Information Technology Education (SIGITE’12). ACM, New York, NY. DOI: http://dx.doi.org/10.1145/2380552.2380603
46. Rebecca Vivian, Katrina Falkner, and Nickolas Falkner. 2014. Addressing the challenges of a new digital technologies curriculum: MOOCs as a scalable solution for teacher professional development. Res Learn. Technol. 22, 1 (2014), 24691. DOI:http://dx.doi.org/10.3402/rlt.v22.24691
47. Etienne Wenger, Richard Arnold McDermott, and William Snyder. 2002. Cultivating Communities of Practice: A Guide to Managing Knowledge. Harvard Business Press.
48. Cameron Wilson. 2013. What’s up next for Code.org? IEEE Comput. 46, 8, 95--97. DOI:http://dx.doi.org/10.1109/MC.2013.292
49. Eric Wiebe, Laurie Williams, Kai Yang, and Carol Miller. 2003. Computer science attitude survey. Comput. Sci. 14, 25 (January 2003), 0-86.

Index Terms

• Social and professional topics

  • Professional topics

    • Computing education

      • Computing education programs

        • Computer science education