skip to main content
10.1145/953536.953544acmconferencesArticle/Chapter ViewAbstractPublication PagesidcConference Proceedingsconference-collections
Article

Assessing usability evaluation methods on their effectiveness to elicit verbal comments from children subjects

Published:01 July 2003Publication History

ABSTRACT

An exploratory study is described looking at children's ability to provide verbal comments in usability evaluation sessions. Six evaluation methods were applied to test an interactive toy by children aged 6 and 7. The results show that most verbal comments were gathered during Active Intervention sessions, by asking children questions during tasks. Unexpectedly, the Co-Discovery sessions were less successful, because children did not collaborate very well. Children also provided useful comments in the Thinking Aloud, Retrospection, and Peer Tutoring sessions. They could reflect on their actions at the end of Retrospection sessions, and were able to teach other children how to interact with the toy in Peer Tutoring sessions.

References

  1. Acuff, D. (1997) What Kids Buy and Why, The Psychology of Marketing to Kids, The Free Press, New York, NY Chapter 5.Google ScholarGoogle Scholar
  2. Berk, L. E., (1997), Child Development. Allyn and Bacon, Massachusetts, USA.Google ScholarGoogle Scholar
  3. Benford, S., Bederson, B. B., et. al., (2000), Designing Storytelling Technologies to Encourage Collaboration Between Young Children. CHI Letters Vol. 2, issue 1, page 556--562. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Dumas, J. R. and J. C. Redish. (1993). A Practical Guide to Usability Testing. Ablex Publishing Corporation, Norwood NJ. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Hackman, G. S. & Biers, D. W. (1992). Team usability testing: Are two heads better than one? Proceedings of the Human Factors Society 36th Annual Meeting, 1205--1209. Santa Monica, CA: HFES.Google ScholarGoogle ScholarCross RefCross Ref
  6. Hanna, L., Risden, K., & Alexander, K. (1997, September + October). Guidelines for usability testing with children. Interactions, 4(5), 9--14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Hoysniemi, J., Hamalainen, P., Turkki, L., (2002) Using Peer Tutoring in Evaluating Usability of Physically Interactive Computer Game with Children. International Conference on Interaction Design and Children, Eindhoven, The Netherlands. August 2002, page 144--1526.Google ScholarGoogle Scholar
  8. Kemp, J. A. M. and Gelderen, van T. (1996) Co-discovery exploration: an informal method for iterative design of consumer products, In. Jordan, P. W., Thomas, B, Weerdmeester, B. A., and McClelland, I. L. (eds.) Usability Evaluation in Industry, London: Taylor and Francis, 139--146.Google ScholarGoogle Scholar
  9. Larkin, S. (2002) Usability, Jr. - How to run a successful Usability Test with Children. Newsletter of Usability Special Interest Group 2002, Vol. 8, No. 3. URL: http://www.stcsig.org/usability/newsletter/0201_usabilityjr.html seen at 3-6-02.Google ScholarGoogle Scholar
  10. Markopoulos, P., Bekker, M. M. (2002), How to compare usability testing methods with children participants, International conference of Interaction Design and Children. Eindhoven, The Netherlands. August 2002. Page 153--158.Google ScholarGoogle Scholar
  11. Norman, D. A. (1986), Cognitive Engineering, In: Norman, D. A. and Draper, S. W. (Eds.), User Centred System Design, Lawrence Erlbaum associates, Hillsdale, N.J., 31--61.Google ScholarGoogle Scholar
  12. Ohnemus, K. R. & Biers, D. W. (1993). Retrospective versus concurrent thinking-out-loud in usability testing. Proceedings of the Human Factors and Ergonomics Society 37th Annual Meeting, 1127--1131. Santa Monica, CA.Google ScholarGoogle ScholarCross RefCross Ref
  13. Rooden, M. J.(1998) Thinking about thinking aloud. In: M. A. HANSON * (eds.); Proceedings of the Annual Conference of the Ergonomics Society. (Cirencester (UK), I -4- 1998), Taylor & Francis, London (UK), 1998, p. 328--332. ISBN: 07484-0811-8.Google ScholarGoogle Scholar
  14. Wilson, C. (1998) Usability Techniques. Pros and cons of Co-participating in usability studies. Usability Interface. Vol. 4 No 4 April 1998.Google ScholarGoogle Scholar
  1. Assessing usability evaluation methods on their effectiveness to elicit verbal comments from children subjects

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      IDC '03: Proceedings of the 2003 conference on Interaction design and children
      July 2003
      164 pages
      ISBN:158113732X
      DOI:10.1145/953536

      Copyright © 2003 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 1 July 2003

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • Article

      Acceptance Rates

      Overall Acceptance Rate172of578submissions,30%

      Upcoming Conference

      IDC '24
      Interaction Design and Children
      June 17 - 20, 2024
      Delft , Netherlands

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader