skip to main content
10.1145/2460296.2460316acmconferencesArticle/Chapter ViewAbstractPublication PageslakConference Proceedingsconference-collections
research-article

Multimodal learning analytics

Published:08 April 2013Publication History

ABSTRACT

New high-frequency data collection technologies and machine learning analysis techniques could offer new insights into learning, especially in tasks in which students have ample space to generate unique, personalized artifacts, such as a computer program, a robot, or a solution to an engineering challenge. To date most of the work on learning analytics and educational data mining has focused on online courses or cognitive tutors, in which the tasks are more structured and the entirety of interaction happens in front of a computer. In this paper, I argue that multimodal learning analytics could offer new insights into students' learning trajectories, and present several examples of this work and its educational application.

References

  1. Amershi, S., & Conati, C. 2009. Combining Unsupervised and Supervised Classification to Build User Models for Exploratory Learning Environments. Journal of Educational Data Mining, 1(1), 18--71.Google ScholarGoogle Scholar
  2. Baker, R. & Yacef, K. 2009. The State of Educational Data Mining in 2009: A Review and Future Visions. Journal of Educational Data Mining, 1(1).Google ScholarGoogle Scholar
  3. Baker, R. S., Corbett, A. T., Koedinger, K. R., & Wagner, A. Z. 2004. Off-task behavior in the cognitive tutor classroom: when students "game the system". Proceedings of the SIGCHI conference on Human factors in computing systems. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Blikstein, P. 2011. Using learning analytics to assess students' behavior in open-ended programming tasks, in Proceedings of the 1st International Conference on Learning Analytics and Knowledge. ACM: Banff, Canada. 110--116. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Barron, B., & Darling-Hammond, L. 2010. Prospects and challenges for inquiry-based approaches to learning: OECD.Google ScholarGoogle Scholar
  6. Beck, J. E., & Sison, J. 2006. Using Knowledge Tracing in a Noisy Environment to Measure Student Reading Proficiencies. International Journal of Artificial Intelligence in Education, 16(2), 129--143. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Chris Manning and Hinrich Schütze, Foundations of Statistical Natural Language Processing, MIT Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. D'Mello, S., Craig, S., Witherspoon, A., McDaniel, B., & Graesser, A. 2008. Automatic detection of learner's affect from conversational cues. User Modeling and User-Adapted Interaction, 18(1), 45--80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Dewey, J. 1902. The school and society. U of Chicago Press.Google ScholarGoogle Scholar
  10. Dutson, A. J., Todd, R. H., Magleby, S. P., & Sorensen, C. D. 1997. A Review of Literature on Teaching Engineering Design through Project-Oriented Capstone Courses. J of Engineering Education, 86(1), 17--28.Google ScholarGoogle ScholarCross RefCross Ref
  11. Dym, C. L. 1999. Learning Engineering: Design, Languages, and Experiences. J of Engineering Education, 145--148.Google ScholarGoogle Scholar
  12. Freire, P. 1970. Pedagogia do Oprimido. Paz e Terra, Rio de Janeiro.Google ScholarGoogle Scholar
  13. Kirschner, P. A., Sweller, J., & Clark, R. E. 2006. Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching. Educational Psychologist, 41(2), 75--86.Google ScholarGoogle ScholarCross RefCross Ref
  14. Klahr, D., & Nigam, M. 2004. The equivalence of learning paths in early science instruction. Psychological Science, 15(10), 661.Google ScholarGoogle ScholarCross RefCross Ref
  15. Levy, F., & Murnane, R. J. 2004. The new division of labor: How computers are creating the next job market: Princeton University Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Montessori, M. 1965. Spontaneous activity in education. Schocken Books, New York.Google ScholarGoogle Scholar
  17. Pang, Bo and Lillian Lee. 2008. Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval 2(1): 1--135. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Papert, S. 1980. Mindstorms: children, computers, and powerful ideas. Basic Books, New York. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Piech, C., et al. Modeling how students learn to program. 2012. In Proceedings of the 43rd ACM Symposium on Computer Science Education (SIGCSE '12). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Rus, V., Lintean, M. and Azevedo, R. 2009. Automatic Detection of Student Mental Models During Prior Knowledge Activation in MetaTutor. In Proc. of the 2nd Int. Conference on Educational Data Mining. 161--170.Google ScholarGoogle Scholar
  21. Worsley, M. and Blikstein P. 2011. What's an Expert? Using learning analytics to identify emergent markers of expertise through automated speech, sentiment and sketch analysis. In Proceedings for the 4th Annual Conference on Educational Data Mining, Eindhoven, The Netherlands.Google ScholarGoogle Scholar
  22. Worsley, M. and Blikstein P. 2012. A Framework for Characterizing Student Changes in Student Identity During Constructionist Learning Activities. Proceedings of Constructionism 2012, Athens, Greece.Google ScholarGoogle Scholar
  23. Worsley, M. and Blikstein, P. 2013. Toward the Development of Multimodal Action Based Assessment. In Proceedings for the 2013 Learning Analytics and Knowledge (LAK 2013) Conference, Leuven, Belgium. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Multimodal learning analytics

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      LAK '13: Proceedings of the Third International Conference on Learning Analytics and Knowledge
      April 2013
      300 pages
      ISBN:9781450317856
      DOI:10.1145/2460296

      Copyright © 2013 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 8 April 2013

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      LAK '13 Paper Acceptance Rate16of58submissions,28%Overall Acceptance Rate236of782submissions,30%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader