skip to main content
10.1145/2883851.2883936acmotherconferencesArticle/Chapter ViewAbstractPublication PageslakConference Proceedingsconference-collections
research-article

Affecting off-task behaviour: how affect-aware feedback can improve student learning

Published: 25 April 2016 Publication History

Abstract

This paper describes the development and evaluation of an affect-aware intelligent support component that is part of a learning environment known as iTalk2Learn. The intelligent support component is able to tailor feedback according to a student's affective state, which is deduced both from speech and interaction. The affect prediction is used to determine which type of feedback is provided and how that feedback is presented (interruptive or non-interruptive). The system includes two Bayesian networks that were trained with data gathered in a series of ecologically-valid Wizard-of-Oz studies, where the effect of the type of feedback and the presentation of feedback on students' affective states was investigated. This paper reports results from an experiment that compared a version that provided affect-aware feedback (affect condition) with one that provided feedback based on performance only (non-affect condition). Results show that students who were in the affect condition were less bored and less off-task, with the latter being statically significant. Importantly, students in both conditions made learning gains that were statistically significant, while students in the affect condition had higher learning gains than those in the non-affect condition, although this result was not statistically significant in this study's sample. Taken all together, the results point to the potential and positive impact of affect-aware intelligent support.

References

[1]
J. Ahn and P. Brusilovsky. Adaptive visualization for exploratory information retrieval. Information Processing and Management, 49:1139--1164, 2013.
[2]
M. Askeland. Sound-based strategy training in multiplication. European Journal of Special Needs Education, 27(2):201--217, 2012.
[3]
R. S. J. d. Baker, S. K. D'Mello, M. T. Rodrigo, and A. C. Graesser. Better to be frustrated than bored: The incidence, persistence, and impact of learners' cognitive-affective states during interactions with three different computer-based learning environments. Int. J. Hum.-Comput. Stud., 68(4):223--241, apr 2010.
[4]
G. Carenini, C. Conati, E. Hoque, B. Steichen, D. Toker, and J. Enns. Highlighting interventions and user differences: Informing adaptive information visualization support. In CHI '14 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 1835--1844, 2014.
[5]
M. Chi. Self-explaining expository texts: The dual processes of generating inferences and repairing mental models. In R. Glaser, editor, Advances in instructional psychology, pages 161--238. Mahwah, NJ: Lawrence Erbaum Associates, 2000.
[6]
C. Conati and H. MacLaren. Empirically building and evaluating a probabilistic model of user affect. User Modeling and User-Adapted Interaction, 2009.
[7]
T. del Soldato and B. du Boulay. Implementation of motivational tactics in tutoring systems. Journal of Artificial Intelligence in Education, 6(4), 1996.
[8]
S. D'Mello and A. Graesser. Multimodal semi-automated affect detection from conversational cues, gross body language, and facial features. User Modeling and User-adapted Interaction, 20:147--187, 2010.
[9]
S. D'Mello and A. Graesser. Autotutor and affective autotutor: Learning by talking with cognitively and emotionally intelligent computers that talk back. ACM Transactions on Interactive Intelligent Systems, 2(4):1--38, 2013.
[10]
S. K. D'Mello, B. Lehman, R. Pekrun, and A. C. Graesser. Confusion can be beneficial for learning. Learning & Instruction, 29(1):153--170, 2014.
[11]
D. Gotz and Z. Wen. Behaviour driven visualization recommendation. In Intelligent User Interfaces, IUI '09, pages 315--324, 2009.
[12]
B. Grawemeyer and R. Cox. Graphical data displays and database queries: Helping users select the right display for the task. In Smart Graphics, 5th International Symposium, pages 53--64, 2005.
[13]
B. Grawemeyer, W. Holmes, S. Gutiérrez-Santos, A. Hansen, K. Loibl, and M. Mavrikis. Light-bulb moment? towards adaptive presentation of feedback based on students' affective state. In IUI 2015, 2015.
[14]
B. Grawemeyer, M. Mavrikis, A. Hansen, C. Mazziotti, and S. Gutiérrez-Santos. Employing speech to contribute to modelling and adapting to students' affective states. In EC-TEL 2014, 2014.
[15]
B. Grawemeyer, M. Mavrikis, W. Holmes, A. Hansen, K. Loibl, and S. Gutiérrez-Santos. Affect matters: Exploring the impact of feedback during mathematical tasks in an exploratory environmen. In AIED 2015, 2015.
[16]
S. Gutiérrez-Santos, M. Mavrikis, and G. Magoulas. A separation of concerns for engineering intelligent support for exploratory learning environments. Journal of Research and Practice in Information Technology, 44(3):347--360, 2012.
[17]
R. Janning, C. Schatten, and L. Schmidt-Thieme. Feature analysis for affect recognition supporting task sequencing in adaptive intelligent tutoring systems. In EC-TEL 2014, 2014.
[18]
R. Janning, C. Schatten, and L. Schmidt-Thieme. Perceived task-difficulty recognition from log-file information for the use in adaptive intelligent tutoring systems. International Journal of Artificial Intelligence in Education, in press.
[19]
B. Kort, R. Reilly, and R. Picard. An affective model of the interplay between emotions and learning. In IEEE International Conference on Advanced Learning Technologies, number 43-46, 2001.
[20]
M. Mavrikis, B. Grawemeyer, A. Hansen, and S. Gutiérrez-Santos. Exploring the potential of speech recognition to support problem solving and reflection - wizards go to school in the elementary maths classroom. In EC-TEL 2014, pages 263--276, 2014.
[21]
M. Mavrikis, S. Gutiérrez-Santos, E. Geraniou, and R. Noss. Design requirements, student perception indicators and validation metrics for intelligent exploratory learning environments. Personal and Ubiquitous Computing, 17(8):1605--1620, 2013.
[22]
C. Mazziotti, W. Holmes, M. Wiedmann, K. Loibl, N. Rummel, M. Mavrikis, A. Hansen, and B. Grawemeyer. Robust student knowledge: Adapting to individual student needs as they explore the concepts and practice the procedures of fractions. In Workshop on Intelligent Support in Exploratory and Open-ended Learning Environments Learning Analytics for Project Based and Experiential Learning Scenarios at AIED 2015, 2015.
[23]
J. Ocumpaugh, R. Baker, and M. Rodrigo. Baker-rodrigo observation method protocol (bromp) 1.0. training manual version 1.0. Technical report, New York, NY: EdLab. Manila, Philippines: Ateneo Laboratory for the Learning Sciences., 2012.
[24]
R. Pekrun. The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. J. Edu. Psych. Rev., pages 315--341, 2006.
[25]
K. Porayska-Pomsta, M. Mavrikis, and H. Pain. Diagnosing and acting on student affect: the tutor's perspective. User Modeling and User-Adapted Interaction, 18(1):125--173, 2008.
[26]
Sail-Labs. http://www.sail-labs.com.
[27]
S. Salmeron-Majadas, O. Santos, and J. Boticario. Exploring indicators from keyboard and mouse interactions to predict the user affective state. In EDM 2014, 2014.
[28]
O. Santos, M. Saneiro, S. Salmeron-Majadas, and B. J. G. A methodological approach to elicit affective educational recommendataions. In IEEE 14th International Conference on Advanced Learning Technologies, 2014.
[29]
L. Shen, M. Wang, and R. Shen. Affective e-learning: Using "emotional" data to improve learning in pervasive learning environment. Educational Technology & Society, 12(2):176--189, 2009.
[30]
J. Sweller, J. G. van Merrienboer, and G. W. Paas. Cognitive Architecture and Instructional Design. Educational Psychology Review, 10:251--296+, 1998.
[31]
T. Vogt and E. André. Comparing feature sets for acted and spontaneous speech in view of automatic emotion recognition. In Multimedia and Expo (ICME05), pages 474--477, 2005.
[32]
B. Woolf, W. Burleson, I. Arroyo, T. Dragon, D. Cooper, and R. Picard. Affect-aware tutors: recognising and responding to student affect. Int. J. Learning Technology, 4(3-4):129--164, 2009.

Cited By

View all
  • (2024)Utilization of Artificial Intelligence in Education: A Perspective on Learning StrategiesArtificial Intelligence for Quality Education [Working Title]10.5772/intechopen.1005086Online publication date: 16-May-2024
  • (2024)Empowering Private Tutoring by Chaining Large Language ModelsProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679665(354-364)Online publication date: 21-Oct-2024
  • (2024)Teacher support, academic engagement and learning anxiety in online foreign language learningBritish Journal of Educational Technology10.1111/bjet.1343055:5(2151-2172)Online publication date: 26-Feb-2024
  • Show More Cited By

Index Terms

  1. Affecting off-task behaviour: how affect-aware feedback can improve student learning

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      LAK '16: Proceedings of the Sixth International Conference on Learning Analytics & Knowledge
      April 2016
      567 pages
      ISBN:9781450341905
      DOI:10.1145/2883851
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 25 April 2016

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. affect
      2. exploratory learning environments
      3. feedback

      Qualifiers

      • Research-article

      Funding Sources

      Conference

      LAK '16

      Acceptance Rates

      LAK '16 Paper Acceptance Rate 36 of 116 submissions, 31%;
      Overall Acceptance Rate 236 of 782 submissions, 30%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)30
      • Downloads (Last 6 weeks)3
      Reflects downloads up to 19 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Utilization of Artificial Intelligence in Education: A Perspective on Learning StrategiesArtificial Intelligence for Quality Education [Working Title]10.5772/intechopen.1005086Online publication date: 16-May-2024
      • (2024)Empowering Private Tutoring by Chaining Large Language ModelsProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679665(354-364)Online publication date: 21-Oct-2024
      • (2024)Teacher support, academic engagement and learning anxiety in online foreign language learningBritish Journal of Educational Technology10.1111/bjet.1343055:5(2151-2172)Online publication date: 26-Feb-2024
      • (2024)Application Strategies of Brain-computer Interface in Education from the Perspective of Innovation Diffusion TheoryBrain-Apparatus Communication: A Journal of Bacomics10.1080/27706710.2024.23763683:1Online publication date: 22-Jul-2024
      • (2024)Effects of Self-Regulated Learning Prompts at Three Different Phases in Video-Based LearningJournal of Formative Design in Learning10.1007/s41686-024-00093-z8:2(71-81)Online publication date: 9-Sep-2024
      • (2024)Analysis of the Effectiveness of Feedback Provision in Intelligent Tutoring SystemsComputing and Informatics10.1007/978-981-99-9592-9_13(168-179)Online publication date: 26-Jan-2024
      • (2023)Intelligent Augmented Reality for Learning GeometryInformation10.3390/info1404024514:4(245)Online publication date: 17-Apr-2023
      • (2022)Adaptive Cognitive Training with Reinforcement LearningACM Transactions on Interactive Intelligent Systems10.1145/347677712:1(1-29)Online publication date: 4-Mar-2022
      • (2022)Connecting the dots – A literature review on learning analytics indicators from a learning design perspectiveJournal of Computer Assisted Learning10.1111/jcal.1271640:6(2432-2470)Online publication date: 26-Jul-2022
      • (2021)Roles of emotions induced by immediate feedback in a physics problem-solving activityInternational Journal of Science Education10.1080/09500693.2021.1922778(1-29)Online publication date: 8-May-2021
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media