short-paper

A qualitative evaluation of a learning dashboard to support advisor-student dialogues

Authors:

Tinne De LaetAuthors Info & Claims

LAK '18: Proceedings of the 8th International Conference on Learning Analytics and Knowledge

Pages 56 - 60

https://doi.org/10.1145/3170358.3170417

Published: 07 March 2018 Publication History

Get Access

Abstract

This paper presents an evaluation of a learning dashboard that supports the dialogue between a student and a study advisor. The dashboard was designed, developed, and evaluated in collaboration with study advisers. To ensure scalability to other contexts, the dashboard uses data that is commonly available at any higher education institute. It visualizes the grades of the student, an overview of the progress through the year, his/her position in comparison with peers, sliders to plan the next years and a prediction of the length of the bachelor program for this student in years based on historic data. The dashboard was deployed at KU Leuven, Belgium and used in September 2017 to support 224 sessions between students and study advisers. We observed twenty of these conversations. We also collected feedback from 101 students with questionnaires. Results of our observations indicate that the dashboard primarily triggers insights at the beginning of a conversation. The number of insights and the level of these insights (factual, interpretative and reflective) depends on the context of the conversation. Most insights were triggered in conversations with students doubting to continue the program, indicating that our dashboard is useful to support difficult decision-making processes.

References

[1]

K. E. Arnold and M. D. Pistilli. Course signals at purdue: Using learning analytics to increase student success. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, pages 267--270. ACM, 2012.

Digital Library

Google Scholar

[2]

R. Bodily and K. Verbert. Review of research on student-facing learning analytics dashboards and educational recommender systems. IEEE Transactions on Learning Technologies, pages 1--14, 2017.

Digital Library

Google Scholar

[3]

T. Broos, L. Peeters, K. Verbert, C. Van Soom, G. Langie, and T. De Laet. Dashboard for actionable feedback on learning skills: Scalability and usefulness. In International Conference on Learning and Collaboration Technologies, pages 229--241. Springer, 2017.

Crossref

Google Scholar

[4]

S. Charleer, A. V. Moere, J. Klerkx, K. Verbert, and T. De Laet. Learning analytics dashboards to support adviser-student dialogue. IEEE Transactions on Learning Technologies, pages 1--12, 2017.

Google Scholar

[5]

S. Claes and A. V. Moere. The role of tangible interaction in exploring information on public visualization displays. In Proceedings of the 4th International Symposium on Pervasive Displays, pages 201--207. ACM, 2015.

Digital Library

Google Scholar

[6]

M. King. Co-tutor: a relationship management system to enable staff to monitor students' engagement and provide support to at risk students. Compendium of effective practice in higher education retention and success, pages 121--124, 2012.

Google Scholar

[7]

M. Scheffel, H. Drachsler, C. Toisoul, S. Ternier, and M. Specht. The proof of the pudding: examining validity and reliability of the evaluation framework for learning analytics. In European Conference on Technology Enhanced Learning, pages 194--208. Springer, 2017.

Crossref

Google Scholar

[8]

R. Stoneham. Failing students need big data and learning analytics: Hype or reality? Compass: Journal of Learning and Teaching, 7(11), 2015.

Google Scholar

[9]

K. Verbert, E. Duval, J. Klerkx, S. Govaerts, and J. L. Santos. Learning analytics dashboard applications. American Behavioral Scientist, 57(10):1500--1509, 2013.

Crossref

Google Scholar

[10]

K. Verbert, S. Govaerts, E. Duval, J. Santos, F. Van Assche, G. Parra, and J. Klerkx. Learning dashboards: an overview and future research opportunities. Personal and Ubiquitous Computing, 18(6):1499--1514, 2014.

Digital Library

Google Scholar

Cited By

View all

Alipour SElahimanesh SJahanzad SMohammadi IMorassafar PNeshaei STefagh M(2024)Improving Grading Fairness and Transparency with Decentralized Collaborative Peer AssessmentProceedings of the ACM on Human-Computer Interaction10.1145/36373508:CSCW1(1-24)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637350
Barthakur AMarrone REsnaashari SKovanovic VDawson S(2024)A Systematic Review of Studies on Decision-Making Systems for Teaching and Learning in K-12Technology Enhanced Learning for Inclusive and Equitable Quality Education10.1007/978-3-031-72315-5_4(49-63)Online publication date: 16-Sep-2024
https://dl.acm.org/doi/10.1007/978-3-031-72315-5_4
Atalla SDaradkeh MGawanmeh AKhalil HMansoor WMiniaoui SHimeur Y(2023)An Intelligent Recommendation System for Automating Academic Advising Based on Curriculum Analysis and Performance ModelingMathematics10.3390/math1105109811:5(1098)Online publication date: 22-Feb-2023
https://doi.org/10.3390/math11051098
Show More Cited By

Index Terms

A qualitative evaluation of a learning dashboard to support advisor-student dialogues

Recommendations

Evaluating a Learning Analytics Dashboard to Visualize Student Self-Reports of Time-on-task: A Case Study in a Latin American University
LAK21: LAK21: 11th International Learning Analytics and Knowledge Conference

In recent years, instructional design has become even more challenging for teaching staff members in higher education institutions. If instructional design causes student overload, it could lead to superficial learning and decreased student well-being. ...
A framework for designing fisheye views to support multiple semantic contexts
AVI '02: Proceedings of the Working Conference on Advanced Visual Interfaces

In this paper we discuss the design and use of fisheye view techniques to explore semantic relationships in information. Traditional fisheye and "focus + context" techniques dynamically modify the visual rendering of data in response to the changing ...
Prescriptive analytics motivating distance learning students to take remedial action: A case study of a student-facing dashboard
LAK '25: Proceedings of the 15th International Learning Analytics and Knowledge Conference
Student-facing learning analytics dashboards aim to help students to monitor their study progress, achieve learning goals and develop self-regulation skills. Only few of them present personalised data visualisations and aim to develop agentic students who ...

Comments

Information & Contributors

Information

Published In

LAK '18: Proceedings of the 8th International Conference on Learning Analytics and Knowledge

March 2018

489 pages

ISBN:9781450364003

DOI:10.1145/3170358

Conference Chairs:
Abelardo Pardo
The University of Sydney, AUS
,
Kathryn Bartimote-Aufflick
The University of Sydney, AUS
,
Grace Lynch
Society for Learning Analytics Research, AUS
,
Program Chairs:
Simon Buckingham Shum
University of Technology Sydney, AUS
,
Rebecca Ferguson
The Open University, UK
,
Agathe Merceron
Beuth University of Applied Sciences, GER
,
Xavier Ochoa
Escuela Superior Politécnica del Litoral, EC

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 March 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

European Union

Conference

LAK '18

LAK '18: International Conference on Learning Analytics and Knowledge

March 7 - 9, 2018

New South Wales, Sydney, Australia

Acceptance Rates

LAK '18 Paper Acceptance Rate 35 of 115 submissions, 30%;

Overall Acceptance Rate 236 of 782 submissions, 30%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
715
Total Downloads

Downloads (Last 12 months)29
Downloads (Last 6 weeks)3

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Alipour SElahimanesh SJahanzad SMohammadi IMorassafar PNeshaei STefagh M(2024)Improving Grading Fairness and Transparency with Decentralized Collaborative Peer AssessmentProceedings of the ACM on Human-Computer Interaction10.1145/36373508:CSCW1(1-24)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637350
Barthakur AMarrone REsnaashari SKovanovic VDawson S(2024)A Systematic Review of Studies on Decision-Making Systems for Teaching and Learning in K-12Technology Enhanced Learning for Inclusive and Equitable Quality Education10.1007/978-3-031-72315-5_4(49-63)Online publication date: 16-Sep-2024
https://dl.acm.org/doi/10.1007/978-3-031-72315-5_4
Atalla SDaradkeh MGawanmeh AKhalil HMansoor WMiniaoui SHimeur Y(2023)An Intelligent Recommendation System for Automating Academic Advising Based on Curriculum Analysis and Performance ModelingMathematics10.3390/math1105109811:5(1098)Online publication date: 22-Feb-2023
https://doi.org/10.3390/math11051098
Heredia Jimenez VValeriano ITorres DJimenez-Macías AOrtiz-Rojas M(2023)Beyond Numbers: Exploring the Qualitative Dimension of a Learning Analytics Dashboard’s UsefulnessProceedings of the 18th Latin American Conference on Learning Technologies (LACLO 2023)10.1007/978-981-99-7353-8_7(75-85)Online publication date: 17-Oct-2023
https://doi.org/10.1007/978-981-99-7353-8_7
De Laet T(2023)Learning Dashboards for Academic Advising in PracticePracticable Learning Analytics10.1007/978-3-031-27646-0_4(55-75)Online publication date: 31-Mar-2023
https://doi.org/10.1007/978-3-031-27646-0_4
Williamson KKizilcec RWise AMartinez-Maldonado RHilliger I(2022)A Review of Learning Analytics Dashboard Research in Higher Education: Implications for Justice, Equity, Diversity, and InclusionLAK22: 12th International Learning Analytics and Knowledge Conference10.1145/3506860.3506900(260-270)Online publication date: 21-Mar-2022
https://dl.acm.org/doi/10.1145/3506860.3506900
Ott CMills SStanger NJohn SZwanenburg S(2021)Is this Degree for Me?Exploring computing students’ study decisionsProceedings of the 23rd Australasian Computing Education Conference10.1145/3441636.3442310(96-105)Online publication date: 2-Feb-2021
https://dl.acm.org/doi/10.1145/3441636.3442310
Plak SCornelisz IMeeter Mvan Klaveren C(2021)Early warning systems for more effective student counselling in higher education: Evidence from a Dutch field experimentHigher Education Quarterly10.1111/hequ.1229876:1(131-152)Online publication date: 9-Feb-2021
https://doi.org/10.1111/hequ.12298
Castro Arias SQuiroz Martinez MLeyva Vazquez MFlores Ortiz A(2021)Architectural Design for the Implementation of Learning Analytics: Case Study at Salesian Polytechnic UniversityAdvances in Human Factors in Training, Education, and Learning Sciences10.1007/978-3-030-80000-0_31(260-268)Online publication date: 27-Jun-2021
https://doi.org/10.1007/978-3-030-80000-0_31
Fang LA. K. M. Z(2020)Dashboard for the E-Assessment and E-Feedback System for Aerospace Engineering Examination Preparation in SingaporeEarly Warning Systems and Targeted Interventions for Student Success in Online Courses10.4018/978-1-7998-5074-8.ch004(64-89)Online publication date: 2020
https://doi.org/10.4018/978-1-7998-5074-8.ch004
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Evaluating a Learning Analytics Dashboard to Visualize Student Self-Reports of Time-on-task: A Case Study in a Latin American University

A framework for designing fisheye views to support multiple semantic contexts

Prescriptive analytics motivating distance learning students to take remedial action: A case study of a student-facing dashboard

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations