ABSTRACT
In formative assessments, one wants to provide a useful feedback to the examinee at the end of the test. In order to reduce the number of questions asked in an assessment, adaptive testing models have been developed for cognitive diagnosis, such as the ones encountered in knowledge space theory. However, when the number of skills assessed is very huge, such methods cannot scale. In this paper, we present a new method to provide adaptive tests and useful feedback to the examinee, even with large databases of skills. It will be used in Pix, a platform for certification of digital competencies for every French citizen.
- Michael Brooks, Sumit Basu, Charles Jacobs, and Lucy Vanderwende. 2014. Divide and correct: using clusters to grade short answers at scale. In Proceedings of the first ACM conference on Learning@ scale conference. ACM, 89--98. Google ScholarDigital Library
- Ying Cheng. 2009. When cognitive diagnosis meets computerized adaptive testing: CD-CAT. Psychometrika 74, 4 (2009), 619--632. Google ScholarCross Ref
- Matthias Davier. 2005. A general diagnostic model applied to language testing data. ETS Research Report Series 2005, 2 (2005), i--35. Google ScholarCross Ref
- Jean-Claude Falmagne, Eric Cosyn, Jean-Paul Doignon, and Nicolas Thiéry. 2006. The assessment of knowledge, in theory and in practice. In Formal concept analysis. Springer, 61--79. Google ScholarDigital Library
- Ronald K. Hambleton, Hariharan Swaminathan, and H. Jane Rogers. 1991. Fundamentals of item response theory. Sage.Google Scholar
- Alan Huebner. 2010. An Overview of Recent Developments in Cognitive Diagnostic Computer Adaptive Assessments. Practical Assessment, Research & Evaluation 15, 3 (2010), 7.Google Scholar
- Jacqueline P. Leighton, Mark J. Gierl, and Stephen M. Hunka. 2004. The Attribute Hierarchy Method for Cognitive Assessment: A Variation on Tatsuoka's Rule-Space Approach. Journal of Educational Measurement 41, 3 (2004), 205--237. Google ScholarCross Ref
- Danny Lynch and Colm P. Howlin. 2014. Real world usage of an adaptive testing algorithm to uncover latent knowledge. (2014).Google Scholar
- Robert J. Mislevy, John T. Behrens, Kristen E. Dicerbo, and Roy Levy. 2012. Design and discovery in educational assessment: Evidence-centered design, psychometrics, and educational data mining. JEDM-Journal of Educational Data Mining 4, 1 (2012), 11--48.Google Scholar
- Vuorikari Riina, Yves Punie, Stephanie Carretero Gomez, and Godelieve Van Den Brande. 2016. DigComp 2.0: The Digital Competence Framework for Citizens. Update Phase 1: the Conceptual Reference Model. Technical Report. Institute for Prospective Technological Studies, Joint Research Centre.Google Scholar
- Jill-Jênn Vie, Fabrice Popineau, Yolaine Bourda, and Éric Bruillard. 2016a. Adaptive Testing Using a General Diagnostic Model. In European Conference on Technology Enhanced Learning. Springer, 331--339. Google ScholarCross Ref
- Jill-Jênn Vie, Fabrice Popineau, Yolaine Bourda, and Éric Bruillard. 2016b. A review of recent advances in adaptive assessment. In Learning analytics: Fundaments, applications, and trends: A view of the current state of the art. Springer, in press.Google Scholar
Index Terms
- A Heuristic Method for Large-Scale Cognitive-Diagnostic Computerized Adaptive Testing
Recommendations
Integrating computerized adaptive testing into UZWEBMAT
Highlights Assessment is an important part of learning process. Adaptive assessment provides an individualized assessment environment for learners. UZWEBMAT was developed for teaching probability unit from 11th grade students. Adaptive assessment module ...
Comments