Can you CopyMe?: an expression mimicking serious game

ABSTRACT

Emotional development is an important aspect in the early years of growth in young children, especially those with psychological disorders like autism spectrum disorders (ASDs), whereby emotional development becomes crucial. However, traditional paper-based interventions for emotional development are mostly laborious and difficult to employ for carers and parents, whilst current computer-aided interventions feel too much like obvious assistive tools and lack timely feedback to inform and aid progress. This paper hence describes the design of CopyMe, a touch-based tablet application that uses game design concepts and state-of-the-art computer vision techniques to provide an engaging experience as well as real-time feedback on the children's progress.

References

1. Battocchi, A., Pianesi, F., Tomasini, D., Zancanaro, M., Esposito, G., Venuti, P., Ben Sasson, A., Gal, E., and Weiss, P. L. 2009. Collaborative Puzzle Game: a tabletop interactive game for fostering collaboration in children with Autism Spectrum Disorders (ASD). In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, ACM, New York, NY, USA, ITS '09, 197--204.
2. Bons, D. M. A., Scheepers, F. E., Rommelse, N. N. J., and Buitelaar, J. K., 2010. Motor, emotional and cognitive empathic abilities in children with autism and conduct disorder.
3. Elzouki, S. Y. A., Fabri, M., and Moore, D. J., 2007. Teaching severely autistic children to recognise emotions: finding a methodology.
4. Gotsis, M., Piggot, J., Hughes, D., and Stone, W. 2010. SMART-games: a video game intervention for children with Autism Spectrum Disorders. In Proceedings of the 9th International Conference on Interaction Design and Children, ACM, New York, NY, USA, IDC '10, 194--197.
5. Hailpern, J., Harris, A., Botz, R. L., Birman, B., and Karahalios, K., 2012. Designing visualizations to facilitate multisyllabic speech with children with autism and speech delays.
6. Harrold, N., Tan, C. T., and Rosser, D. 2012. Towards an expression recognition game to assist the emotional development of children with autism spectrum disorders. In Proceedings of the Workshop at SIGGRAPH Asia on - WASA '12, ACM Press, New York, New York, USA, 33.
7. Hayes, G. R., Hirano, S., Marcu, G., Monibi, M., Nguyen, D. H., and Yeganyan, M. 2010. Interactive visual supports for children with autism. Personal Ubiquitous Comput. 14, 7, 663--680.
8. Mohammedali, M., Phung, D., Adams, B., and Venkatesh, S., 2011. A context-sensitive device to help people with autism cope with anxiety.
9. Park, J. H., Abirached, B., and Zhang, Y., 2012. A framework for designing assistive technologies for teaching children with ASDs emotions.
10. Saragih, J. M., Lucey, S., and Cohn, J. F. 2010. Deformable Model Fitting by Regularized Landmark Mean-Shift. International Journal of Computer Vision 91, 2 (Sept.), 200--215.

Index Terms

• Applied computing

  • Computers in other domains

    • Personal computers and PC applications

      • Computer games

• Computing methodologies

  • Artificial intelligence

    • Computer vision

  • Computer graphics

    • Image manipulation

      • Image processing

• Information systems

  • Information systems applications

    • Multimedia information systems

      • Massively multiplayer online games

• Software and its engineering

  • Software organization and properties

    • Contextual software domains

      • Virtual worlds software

        • Interactive games

• Theory of computation

  • Theory and algorithms for application domains

    • Algorithmic game theory and mechanism design