skip to main content
10.1145/1182475.1182497acmotherconferencesArticle/Chapter ViewAbstractPublication PagesnordichiConference Proceedingsconference-collections
Article

User-centred evaluation of an e-learning repository

Published: 14 October 2006 Publication History

Abstract

The aim of this paper is to reflect on the evaluation of DELTA, a distributed learning resources repository. We employed scenarios and claims analysis techniques so as to derive assessable evaluation goals. These goals were related to three quality dimensions: quality of use, pedagogical effectiveness and acceptability for the end-users. We employed a set of six quantitative and qualitative research methods and triangulated the results obtained. The results demonstrate that DELTA met around half of the evaluation goals. This project was an opportunity to reflect on the degree of fitness for purpose of our methods. Two of the qualitative methods employed (user diaries and pedagogy workshop) were particularly effective in the triangulation process.

References

[1]
DELTA project site. Retrieved the 3rd of April at: http://www.jisc.ac.uk/deletdelta.html
[2]
JISC EERN: The East of England's Educational Resource Network. Retrieved the 3rd of April at: http://www.jisc.ac.uk/index.cfm?name=eern&src=alpha
[3]
Cliff, P., (2002). RDN Resource Types. Retrieved the 3rd of April at: http://www.rdn.ac.uk/publications/cat-guide/types/
[4]
Bloom, B. S. (ed.), (1956). Taxonomy of educational objectives: The classification of educational goals. New York. Longman.
[5]
Mayes, J. T., Fowler, C. J. H., (1999). Learning technology and usability: a framework for understanding courseware. Interacting with Computers Vol. 11, p. 485--497.
[6]
DELTA Expert Evaluation, (2005). Project Deliverable. http://www.essex.ac.uk/chimera/delta/DELTAwalk-thruReport.pdf
[7]
Carroll, J. M., (2000). Making Use: Scenario Based Design of Human Computer Interaction. MIT Press.
[8]
Rosson, M. B., Carroll, J. M., (2002). Usability Engineering: Scenario Based Development of Human Computer Interaction. Academic Press.
[9]
Bevan, N., (1998). Measuring Usability as Quality of Use. Software Quality Journal, Vol. 4, Number 2, p. 115--130.
[10]
Deacon, D. and Bryman, A., Fenton, N., (1998). Collision or collusion? A discussion of the unplanned triangulation of quantitative and qualitative research methods. International Journal of Social Research Methodology, Vol. 1, p 47-- 63.
[11]
Someren, W. M., Barnard, F. Y., Sandberg, A. C. J., (1994). The think aloud method. A practical guide to modeling cognitive process. London: Harcourt Brace & Company.
[12]
Brooke, J., (1996). Software Usability Scale (SUS): a "quick and dirty" usability scale. In P W Jordan, B Thomas, B A Weerdmeester & A L McClelland (eds.) Usability Evaluation in Industry. London: Taylor and Francis.
[13]
Heron, J., Reason, P., (2001). The Practice of Cooperative Inquiry: Research with rather than on people. Chapter 16 of P. Reason & H. Bradbury (Eds.), Handbook of Action Research: Participative Inquiry and Practice (pp. 179--188). London: Sage 2001

Cited By

View all
  • (2020)Interface DesignAdvanced Technology-Assisted Problem Solving in Engineering Education10.4018/978-1-7998-0465-9.ch003(78-112)Online publication date: 2020
  • (2020)Assessing Academics’ Perceptions of Blackboard Usability Using SUS and CSUQ: A Case Study during the COVID-19 PandemicInternational Journal of Human–Computer Interaction10.1080/10447318.2020.1861766(1-13)Online publication date: 26-Dec-2020
  • (2015)Open educational resources repositories literature review - Towards a comprehensive quality approaches frameworkComputers in Human Behavior10.1016/j.chb.2015.03.02651:PB(1098-1106)Online publication date: 1-Oct-2015
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
NordiCHI '06: Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles
October 2006
517 pages
ISBN:1595933255
DOI:10.1145/1182475
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 October 2006

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. e-learning technologies
  2. evaluation
  3. scenarios
  4. soft issues
  5. triangulation
  6. user-centred

Qualifiers

  • Article

Conference

NORDICHI06

Acceptance Rates

Overall Acceptance Rate 379 of 1,572 submissions, 24%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)1
Reflects downloads up to 18 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2020)Interface DesignAdvanced Technology-Assisted Problem Solving in Engineering Education10.4018/978-1-7998-0465-9.ch003(78-112)Online publication date: 2020
  • (2020)Assessing Academics’ Perceptions of Blackboard Usability Using SUS and CSUQ: A Case Study during the COVID-19 PandemicInternational Journal of Human–Computer Interaction10.1080/10447318.2020.1861766(1-13)Online publication date: 26-Dec-2020
  • (2015)Open educational resources repositories literature review - Towards a comprehensive quality approaches frameworkComputers in Human Behavior10.1016/j.chb.2015.03.02651:PB(1098-1106)Online publication date: 1-Oct-2015
  • (2011)User-Centred Evaluation and Organisational Acceptability of a Distributed Repository to Support Communities of LearnersTechnology-Enhanced Systems and Tools for Collaborative Learning Scaffolding10.1007/978-3-642-19814-4_1(1-25)Online publication date: 2011

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media