skip to main content
10.1145/3051457.3054015acmconferencesArticle/Chapter ViewAbstractPublication Pagesl-at-sConference Proceedingsconference-collections
short-paper

A Heuristic Method for Large-Scale Cognitive-Diagnostic Computerized Adaptive Testing

Authors Info & Claims
Published:12 April 2017Publication History

ABSTRACT

In formative assessments, one wants to provide a useful feedback to the examinee at the end of the test. In order to reduce the number of questions asked in an assessment, adaptive testing models have been developed for cognitive diagnosis, such as the ones encountered in knowledge space theory. However, when the number of skills assessed is very huge, such methods cannot scale. In this paper, we present a new method to provide adaptive tests and useful feedback to the examinee, even with large databases of skills. It will be used in Pix, a platform for certification of digital competencies for every French citizen.

References

  1. Michael Brooks, Sumit Basu, Charles Jacobs, and Lucy Vanderwende. 2014. Divide and correct: using clusters to grade short answers at scale. In Proceedings of the first ACM conference on Learning@ scale conference. ACM, 89--98. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Ying Cheng. 2009. When cognitive diagnosis meets computerized adaptive testing: CD-CAT. Psychometrika 74, 4 (2009), 619--632. Google ScholarGoogle ScholarCross RefCross Ref
  3. Matthias Davier. 2005. A general diagnostic model applied to language testing data. ETS Research Report Series 2005, 2 (2005), i--35. Google ScholarGoogle ScholarCross RefCross Ref
  4. Jean-Claude Falmagne, Eric Cosyn, Jean-Paul Doignon, and Nicolas Thiéry. 2006. The assessment of knowledge, in theory and in practice. In Formal concept analysis. Springer, 61--79. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Ronald K. Hambleton, Hariharan Swaminathan, and H. Jane Rogers. 1991. Fundamentals of item response theory. Sage.Google ScholarGoogle Scholar
  6. Alan Huebner. 2010. An Overview of Recent Developments in Cognitive Diagnostic Computer Adaptive Assessments. Practical Assessment, Research & Evaluation 15, 3 (2010), 7.Google ScholarGoogle Scholar
  7. Jacqueline P. Leighton, Mark J. Gierl, and Stephen M. Hunka. 2004. The Attribute Hierarchy Method for Cognitive Assessment: A Variation on Tatsuoka's Rule-Space Approach. Journal of Educational Measurement 41, 3 (2004), 205--237. Google ScholarGoogle ScholarCross RefCross Ref
  8. Danny Lynch and Colm P. Howlin. 2014. Real world usage of an adaptive testing algorithm to uncover latent knowledge. (2014).Google ScholarGoogle Scholar
  9. Robert J. Mislevy, John T. Behrens, Kristen E. Dicerbo, and Roy Levy. 2012. Design and discovery in educational assessment: Evidence-centered design, psychometrics, and educational data mining. JEDM-Journal of Educational Data Mining 4, 1 (2012), 11--48.Google ScholarGoogle Scholar
  10. Vuorikari Riina, Yves Punie, Stephanie Carretero Gomez, and Godelieve Van Den Brande. 2016. DigComp 2.0: The Digital Competence Framework for Citizens. Update Phase 1: the Conceptual Reference Model. Technical Report. Institute for Prospective Technological Studies, Joint Research Centre.Google ScholarGoogle Scholar
  11. Jill-Jênn Vie, Fabrice Popineau, Yolaine Bourda, and Éric Bruillard. 2016a. Adaptive Testing Using a General Diagnostic Model. In European Conference on Technology Enhanced Learning. Springer, 331--339. Google ScholarGoogle ScholarCross RefCross Ref
  12. Jill-Jênn Vie, Fabrice Popineau, Yolaine Bourda, and Éric Bruillard. 2016b. A review of recent advances in adaptive assessment. In Learning analytics: Fundaments, applications, and trends: A view of the current state of the art. Springer, in press.Google ScholarGoogle Scholar

Index Terms

  1. A Heuristic Method for Large-Scale Cognitive-Diagnostic Computerized Adaptive Testing

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          L@S '17: Proceedings of the Fourth (2017) ACM Conference on Learning @ Scale
          April 2017
          352 pages
          ISBN:9781450344500
          DOI:10.1145/3051457

          Copyright © 2017 ACM

          Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 12 April 2017

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • short-paper

          Acceptance Rates

          L@S '17 Paper Acceptance Rate14of105submissions,13%Overall Acceptance Rate117of440submissions,27%

          Upcoming Conference

          L@S '24
          Eleventh ACM Conference on Learning @ Scale
          July 18 - 20, 2024
          Atlanta , GA , USA

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader