skip to main content
10.1145/1414471.1414476acmconferencesArticle/Chapter ViewAbstractPublication PagesassetsConference Proceedingsconference-collections
research-article

A3: a coding guideline for HCI+autism research using video annotation

Published:13 October 2008Publication History

ABSTRACT

Due to the profile of strengths and weaknesses indicative of autism spectrum disorders (ASD), technology may play a key role in ameliorating communication difficulties with this population. This paper documents coding guidelines established through cross-disciplinary work focused on facilitating communication development in children with ASD using computerized feedback. The guidelines, referred to as A3 (pronounced A-Cubed) or Annotation for ASD Analysis, define and operationalize a set of dependent variables coded via video annotation. Inter-rater reliability data are also presented from a study currently in-progress, as well as related discussion to help guide future work in this area. The design of the A3 methodology is well-suited for the examination and evaluation of the behavior of low-functioning subjects with ASD who interact with technology.

References

  1. AbleNet® BIGmack® communicator -- Red. http://www.ablenetinc.com/item_detail.aspx?ItemCode=10000201 Roseville, MN, 2008Google ScholarGoogle Scholar
  2. Altman, D. Practical Statistics/or Medical Research. Chapman and Hall, London, 1991. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Baskett, C. B. The effect of live interactive video on the communicative behavior in children with autism. University of North Carolina at Chapel Hill, Chapel Hill, 1996.Google ScholarGoogle Scholar
  4. Birkimer, J. C. and Brown, J. H. A graphical judgmental aid which summarizes obtained and chance reliability data and helps assess the believability of experimental effects. Journal of Applied Behavior Analysis, 12, 4 (Winter 1979), 523--533.Google ScholarGoogle ScholarCross RefCross Ref
  5. Byrt, T. How good is that agreement? Epidemiology, 7, 5 (September 1996), 561.Google ScholarGoogle ScholarCross RefCross Ref
  6. Cassell, J., Kopp, S., Tepper, P., Ferriman, K. and Striegnitz, K. Trading Spaces: How Humans and Humanoids use Speech and Gesture to Give Directions. John Wiley & Sons, New York, 2007.Google ScholarGoogle Scholar
  7. Center for Disease Control and Prevention, C. Autism Information Center, DD, NCBDDD, CDC. http://www.cdc.gov/ncbddd/autism/ Atlanta, 2007Google ScholarGoogle Scholar
  8. Clifford, J., Marcus, G. E. and School of American Research Writing Culture. University of California Press, Berkeley, California, 1986.Google ScholarGoogle Scholar
  9. Clifton, R. K., Perrisa, E. E. and McCalla, D. D. Does reaching in the dark for unseen objects reflect representation in infants? Infant Behavior and Development, 22, 3 1999), 297--302. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. DeThorne, L. S. and Coletto, M. Visualizing voice: Use of computerized feedback to facilitate vocalizations in children with autism. Proseminar in Speech and Hearing Science University of Illinois at Urbana-Champaign. Champaign, IL, April 2008.Google ScholarGoogle Scholar
  11. Field, T., Field, T., Sanders, C. and Nadel, J. Children with Autism Display more Social Behaviors after Repeated Imitation Sessions. Autism, 5, 3 (Sep 2001), 317--323.Google ScholarGoogle ScholarCross RefCross Ref
  12. Gena, A., Krantz, P., McClannahan, L. and Poulson, C. Training and Generalization of Affective Behavior Displayed by Youth with Autism. Journal of Applied Behavior Analysis, 29, 3 (Fall 1996), 291--304.Google ScholarGoogle ScholarCross RefCross Ref
  13. Hagedorn, J., Hailpern, J. and Karahalios, K. G. VCode and VData: Illustrating a new Framework for Supporting the Video Annotation Workflow. In Proceedings of the Advanced Visual Interfaces (Napoli, Italy, 2008). ACM-PRESS, New York, NY, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Hailpern, J. Encouraging Speech and Vocalization in Children with Autistic Spectrum Disorder. SIGACCESS NEWSLETTER (Sept 2007, 89) 47--52. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Hailpern, J., Karahalios, K., Halle, J., DeThorne, L. and Coletto, M. Creating a Spoken Impact: Audio and Visual Feedback for Children with Autistic Spectrum Disorder. In Proceedings of ({In Preparation}), {In Preparation}.Google ScholarGoogle Scholar
  16. Halle, J. Teaching Language in the Natural Environment: An Analysis of Spontaneity. Journal of the Association for Persons with Severe Handicaps (JASH), 12, 1 (Spring 1987), 28--37.Google ScholarGoogle Scholar
  17. Hayne, H., Gross, J., Hildreth, K. and Rovee-Collier, C. Repeated reminders increase the speed of memory retrieval by 3-month-old infants. Developmental Science, 3, 3 (August 2000), 312--318.Google ScholarGoogle ScholarCross RefCross Ref
  18. Howlin, P. An Overview of Social Behavior in Autism. Plenum, New York, NY, 1986.Google ScholarGoogle Scholar
  19. Kanner, L. Autistic Disturbances of Affective Contact. V.H. Winston, 1943.Google ScholarGoogle Scholar
  20. Kazdin, A. E. Single-Case Research Designs: Methods for Clinical and Applied Setting. Oxford University Press, USA, 1982.Google ScholarGoogle Scholar
  21. Kerr, S. J., Neale, H. R. and Cobb, S. V. G. Virtual environments for social skills training: the importance of scaffolding in practice. In Proceedings of the Proceedings of the fifth international ACM conference on Assistive technologies (Edinburgh, Scotland, 2002, 2002). ACM Press, New York, NY, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Kientz, J. A., Arriaga, R. I., Chetty, M., Hayes, G. R., Richardson, J., Patel, S. N. and Abowd, G. D. Grow and know: understanding record-keeping needs for tracking the development of young children. In Proceedings of the Proceedings of the SIGCHI conference on Human factors in computing systems (San Jose, California, USA, 2007). ACM Press, New York, NY, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Koegel, R. L., Camarata, S., Koegel, L. K., Ben-Tall, A. and Smith, A. E. Increasing Speech Intelligibility in Children with Autism. Journal of Autism and Developmental Disorders, 28, 3 (June 1998), 241--251.Google ScholarGoogle ScholarCross RefCross Ref
  24. Lee, L. Developmental Sentence Analysis. Northwestern University Press, Evanston, IL, 1974.Google ScholarGoogle Scholar
  25. Lord, C., Risi, S., Lambrecht, L., Cook, E. J., Leventhal, B., DiLavore, P., Pickles, A. and Rutter, M. The autism diagnostic observation schedule--generic: a standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders, 30, 3 (June 2000), 205--223.Google ScholarGoogle ScholarCross RefCross Ref
  26. Lovaas, I. I. The Autistic Child. John Wiley & Sons, Inc, New York, 1977.Google ScholarGoogle Scholar
  27. Lovaas, O. I. Teaching Individuals with Developmental Delays: Basic Intervention Techniques. PRO-ED, Inc., Austin, TX, 2003.Google ScholarGoogle Scholar
  28. Luo, Y. and Baillargeon, R. Can a Self-Propelled Box Have a Goal? Psychological Science, 16, 8 (2005 2005), 601--608.Google ScholarGoogle ScholarCross RefCross Ref
  29. McCalla, D. D. and Clifton, R. K. Infants' means-end search for hidden objects in the absence of visual feedback. Infant Behavior and Development, 22, 2 (January 1999), 179--195.Google ScholarGoogle Scholar
  30. McGee, G. G., Krantz, P. J. and McClannahan, L. E. The facilitative effects of incidental teaching on preposition use by autistic children. Journal of Applied Behavior Analysis, 18, 1 (Sprirng 1985), 17--31.Google ScholarGoogle ScholarCross RefCross Ref
  31. Michaud, F. and Théberge-Turmel, C. Mobile robotic toys and autism. Springer, 2002.Google ScholarGoogle ScholarCross RefCross Ref
  32. National Research Council. Educating Children with Autism. Division of Behavioral and Social Sciences and Education, Washington, DC: National Academy Press, 2001.Google ScholarGoogle Scholar
  33. Owens, R. E. Language Development: An Introduction (7th Edition) Allyn & Bacon, Boston, MA, 2007.Google ScholarGoogle Scholar
  34. Parés, N., Carreras, A., Durany, J., Ferrer, J., Freixa, P., Gómez, D., Kruglanski, O., Parés, R., Ribas, J. I., Soler, M. and Sanjurjo, A. Promotion of creative activity in children with severe autism through visuals in an interactive multisensory environment. In Proceedings of the Proceeding of the 2005 conference on Interaction design and children (Boulder, Colorado, 2005). ACM Press, New York, NY, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Prizant, B. M., Schuler, A. L., Wetherby, A. M. and Rydell, P. Enhancing language and communication: Language approaches. Wiley, New York, 1997.Google ScholarGoogle Scholar
  36. Rapin, I. and Dunn, M. Language disorders in children with autism. Seminars in Pediatric Neurology, 4, 2 (June 1997), 86--92Google ScholarGoogle ScholarCross RefCross Ref
  37. Reichle, J., Beukelman, D. and Light, J. Implementing an augmentative communication system: Exemplary strategies for beginning communicators. Brookes Publishing Company, Baltimore, MD, 2002.Google ScholarGoogle Scholar
  38. Reid, D. H., Parsons, M. B., McCarn, J. E., Green, C. W., Phillips, J. F. and Schepis, M. M. Providing a more appropriate education for severely handicapped persons: increasing and validating functional classroom tasks. Journal of Applied Behavior Analysis, 18, 4 (Winter 1985), 289--301.Google ScholarGoogle ScholarCross RefCross Ref
  39. Retherford, K. S. Guide to Analysis of Language Transcripts. Thinking Publications, Eau Claire, Wisconsin, 1993.Google ScholarGoogle Scholar
  40. Rosenblum, K. L., Zeanah, C., McDonough, S. and Muzik., M. Video-taped coding of working model of the child interviews: a viable and useful alternative to verbatim transcripts? Infant Behavior and Development, 27, 4 (December 2004), 544--549.Google ScholarGoogle ScholarCross RefCross Ref
  41. Russo, N., Larson, C. and Kraus, N. Audio-vocal system regulation in children with autism spectrum disorders. Experimental Brain Research, {Epub ahead of print -- 2008}({Epub ahead of print -- 2008} {Epub ahead of print -- 2008}).Google ScholarGoogle Scholar
  42. Sajwaj, T., Twardosz, S. and Burke, M. Side effects of extinction procedures in a remedial preschool. Journal of Applied Behavior Analysis, 5, 2 (Summer 1972), 163--175.Google ScholarGoogle ScholarCross RefCross Ref
  43. Segal, L. B., Oster, H., Cohen, M., Caspi, B., Myers, M. and Brown, D. Smiling and Fussing in Seven-Month-Old Preterm and Full-Term Black Infants in the Still-Face Situation. Child Development, 66, 6 1995), 1829--1843.Google ScholarGoogle ScholarCross RefCross Ref
  44. Sheinkopf, S. J., Mundy, P., Oller, D. K. and Steffens, M. Vocal Atypicalities of Preverbal Autistic Children. Journal of Autism and Developmental Disorders, 30, 4 (August 2000), 345--354.Google ScholarGoogle ScholarCross RefCross Ref
  45. Suchman, L. A. Plans and situated actions: The problem of human-machine communication. Cambridge University Press, New York, NY, 1987. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Tartaro, A. and Cassell, J. Playing with Virtual Peers: Bootstrapping Contingent Discourse in Children with Autism. In Proceedings of the Proceedings of International Conference of the Learning Sciences (Utrecht, Netherlands, June 24--28, 2008). ACM Press, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Wetherby, A. M., Prizant, B. M. and Hutchinson, T. A. Communicative, Social/Affective, and Symbolic Profiles of Young Children With Autism and Pervasive Developmental Disorders. American Journal of Speech--Language Pathology, 7, May (May 1998), 79--91.Google ScholarGoogle Scholar
  48. Whyte, W. The social life of small urban spaces. Conservation Foundation, Washington, DC, 1980.Google ScholarGoogle Scholar
  49. Woods, J. J. and Wetherby, A. M. Early Identification of and Intervention for Infants and Toddlers Who Are at Risk for Autism Spectrum Disorder. Language, Speech, and Hearing Services in Schools, 34, July 2003 (July 2003), 180--193.Google ScholarGoogle Scholar

Index Terms

  1. A3: a coding guideline for HCI+autism research using video annotation

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        Assets '08: Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility
        October 2008
        332 pages
        ISBN:9781595939760
        DOI:10.1145/1414471

        Copyright © 2008 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 13 October 2008

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        Overall Acceptance Rate436of1,556submissions,28%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader