skip to main content
10.1145/3170358.3170419acmotherconferencesArticle/Chapter ViewAbstractPublication PageslakConference Proceedingsconference-collections
short-paper

Multi-institutional positioning test feedback dashboard for aspiring students: lessons learnt from a case study in flanders

Published: 07 March 2018 Publication History

Abstract

Our work focuses on a multi-institutional implementation and evaluation of a Learning Analytics Dashboards (LAD) at scale, providing feedback to N=337 aspiring STEM (science, technology, engineering and mathematics) students participating in a region-wide positioning test before entering the study program. Study advisors were closely involved in the design and evaluation of the dashboard. The multi-institutional context of our case study requires careful consideration of external stakeholders and data ownership and portability issues, which gives shape to the technical design of the LAD. Our approach confirms students as active agents with data ownership, using an anonymous feedback code to access the LAD and to enable students to share their data with institutions at their discretion. Other distinguishing features of the LAD are the support for active content contribution by study advisors and LATEX type-setting of question item feedback to enhance visual recognizability. We present our lessons learnt from a first iteration in production.

References

[1]
Robert Bodily, Judy Kay, Vincent Aleven, Dan Davis, Ioana Jivet, Franceska Xhakaj, and Katrien Verbert. 2018. Open learner models and learning analytics dashboards: a systematic review. In Proceedings of the Eight International Conference on Learning Analytics & Knowledge. ACM.
[2]
Robert Bodily and Katrien Verbert. 2017. Review of research on student-facing learning analytics dashboards and educational recommender systems. IEEE Transactions on Learning Technologies (2017), 1--14.
[3]
Sven Charleer, Andrew Vande Moere, Joris Klerkx, Katrien Verbert, and Tinne De Laet. 2017. Learning Analytics Dashboards to Support Adviser-Student Dialogue. IEEE Transactions on Learning Technologies (2017), 1--12.
[4]
Ángel Del Blanco, Ángel Serrano, Manuel Freire, Iván Martínez-Ortiz, and Baltasar Fernández-Manjón. 2013. E-Learning standards and learning analytics. Can data collection be improved by using standard data models?. In Global Engineering Education Conference (EDUCON), 2013 IEEE. IEEE, 1255--1261.
[5]
Leon Festinger. 1954. A theory of social comparison processes. Human relations 7, 2 (1954), 117--140.
[6]
John Hattie and Helen Timperley. 2007. The power of feedback. Review of educational research 77, 1 (2007), 81--112.
[7]
Mohammad Khalil and Martin Ebner. 2016. De-identification in learning analytics. Journal of Learning Analytics 3, 1 (2016), 129--138.
[8]
O. Lisa, M. Morag, P. Margaret, H. Nuala, M. Geraldine, R. Seamus, and M. Conor. 2016. Technology- Enabled Feedback in the First Year: A synthesis of the literature. Technical Report. http://www.teachingandlearning.ie/wp-content/uploads/2016/10/SynthesisoftheLiterature2016.pdf
[9]
David Nicol. 2009. Assessment for learner self-regulation: enhancing achievement in the first year using learning technologies. Assessment & Evaluation in Higher Education 34, 3 (2009), 335--352.
[10]
Maarten Pinxten, Bieke De Fraine, Wim Van Den Noortgate, Jan Van Damme, Tinneke Boonen, and Gudrun Vanlaar. 2015. `I choose so I am': a logistic analysis of major selection in university and successful completion of the first year. Studies in Higher Education 40, 10 (2015), 1919--1946.
[11]
Maarten Pinxten, Tinne De Laet, Carolien Van Soom, and Greet Langie. 2015. Fighting increasing drop-out rates in the STEM field: The European readySTEMgo Project. In Proceedings of the 43rd Annual SEFI Conference. 1--8.
[12]
Maarten Pinxten, Carolien Van Soom, Christine Peeters, Tinne De Laet, Pal Pacher, Peter Hockicko, and Greet Langie. 2016. Learning and study strategies of incoming science and engineering students. A comparative study between three institutions in Belgium, Slovakia, and Hungary. In Proceedings of the 44rd Annual SEFI Conference. 1--8.
[13]
Michelle Richardson, Charles Abraham, and Rod Bond. 2012. Psychological correlates of university students' academic performance: a systematic review and meta-analysis. Psychological bulletin 138, 2 (2012), 353.
[14]
Maren Scheffel, Hendrik Drachsler, Christian Toisoul, Stefaan Ternier, and Marcus Specht. 2017. The proof of the pudding: examining validity and reliability of the evaluation framework for learning analytics. In European Conference on Technology Enhanced Learning. Springer, 194--208.
[15]
Beat A Schwendimann, María Jesús Rodríguez-Triana, Andrii Vozniuk, Luis P Prieto, Mina Shirvani Boroujeni, Adrian Holzer, Denis Gillet, and Pierre Dillenbourg. 2016. Understanding learning at a glance: An overview of learning dashboard studies. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge. ACM, 532--533.
[16]
Sharon Slade and Paul Prinsloo. 2013. Learning Analytics. American Behavioral Scientist 57, 10 (2013), 1510--1529.
[17]
V. Tinto. 2012. Leaving College: Rethinking the Causes and Cures of Student Attrition. University of Chicago Press.
[18]
Jef Vanderoost, Carolien Van Soom, Greet Langie, Johan Van den Bossche, Riet Callens, Joos Vandewalle, and Tinne De Laet. 2015. Engineering and science positioning tests in Flanders: powerful predictors for study success?. In Proceedings of the 43rd Annual SEFI Conference. 1--8.
[19]
Joos Vandewalle and R Callens. 2013. A positioning test mathematics in Flanders for potential academic engineering students. In Proc. of the 41st SEFI Conference. 1--8.
[20]
Katrien Verbert, Sten Govaerts, Erik Duval, Jose Luis Santos, Frans Van Assche, Gonzalo Parra, and Joris Klerkx. 2014. Learning dashboards: an overview and future research opportunities. Personal and Ubiquitous Computing 18, 6 (2014), 1499--1514.
[21]
Claire E Weinstein, SA Zimmerman, and DR Palmer. 1988. Assessing learning strategies: The design and development of the LASSI. Learning and study strategies: Issues in assessment, instruction, and evaluation (1988), 25--40.

Cited By

View all
  • (2024)Evidence‐based multimodal learning analytics for feedback and reflection in collaborative learningBritish Journal of Educational Technology10.1111/bjet.1349855:5(1900-1925)Online publication date: 22-Jun-2024
  • (2024)Learning analytics dashboards are increasingly becoming about learning and not just analytics - A systematic reviewEducation and Information Technologies10.1007/s10639-023-12401-429:11(14279-14308)Online publication date: 1-Aug-2024
  • (2023)An Intelligent Recommendation System for Automating Academic Advising Based on Curriculum Analysis and Performance ModelingMathematics10.3390/math1105109811:5(1098)Online publication date: 22-Feb-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
LAK '18: Proceedings of the 8th International Conference on Learning Analytics and Knowledge
March 2018
489 pages
ISBN:9781450364003
DOI:10.1145/3170358
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 March 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. case study
  2. feedback
  3. higher education
  4. learning analytics
  5. positioning test
  6. student dashboard

Qualifiers

  • Short-paper

Funding Sources

  • European Commission

Conference

LAK '18
LAK '18: International Conference on Learning Analytics and Knowledge
March 7 - 9, 2018
New South Wales, Sydney, Australia

Acceptance Rates

LAK '18 Paper Acceptance Rate 35 of 115 submissions, 30%;
Overall Acceptance Rate 236 of 782 submissions, 30%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)16
  • Downloads (Last 6 weeks)0
Reflects downloads up to 01 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Evidence‐based multimodal learning analytics for feedback and reflection in collaborative learningBritish Journal of Educational Technology10.1111/bjet.1349855:5(1900-1925)Online publication date: 22-Jun-2024
  • (2024)Learning analytics dashboards are increasingly becoming about learning and not just analytics - A systematic reviewEducation and Information Technologies10.1007/s10639-023-12401-429:11(14279-14308)Online publication date: 1-Aug-2024
  • (2023)An Intelligent Recommendation System for Automating Academic Advising Based on Curriculum Analysis and Performance ModelingMathematics10.3390/math1105109811:5(1098)Online publication date: 22-Feb-2023
  • (2023)Effectiveness of a gamified learning analytics dashboard with coregulation mechanism for self-regulated learning in college ethics coursesInteractive Learning Environments10.1080/10494820.2023.227774132:10(6628-6644)Online publication date: 6-Nov-2023
  • (2023)A decade of research into the application of big data and analytics in higher education: A systematic review of the literatureEducation and Information Technologies10.1007/s10639-023-12033-829:5(5807-5831)Online publication date: 20-Jul-2023
  • (2022)Towards an Online Self-Assessment for Informed Study Decisions–A Mixed-Methods Validation StudyInternational Journal of Assessment Tools in Education10.21449/ijate.9491609:2(376-396)Online publication date: 1-May-2022
  • (2022)Do Self-Assessments for Informed Study Decisions Actually Inform Study Decisions? A Model for Evaluating the Consequential Validity AspectJournal of College Student Retention: Research, Theory & Practice10.1177/1521025122111712626:3(694-720)Online publication date: 7-Sep-2022
  • (2022)Lessons learned from designing a curriculum analytics tool for improving student learning and program qualityJournal of Computing in Higher Education10.1007/s12528-022-09315-434:3(633-657)Online publication date: 31-Mar-2022
  • (2021)Development and Evaluation of a Student-Facing Gamified Learning Analytics DashboardVisualizations and Dashboards for Learning Analytics10.1007/978-3-030-81222-5_13(269-287)Online publication date: 17-Dec-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media