Tag around: a 3D gesture game for image annotation

ABSTRACT

Manual annotation is difficult to perform in large image databases and the automatic methods deliver results that are far from what is desired by the users. New and fun ways to provide image annotation are required. This paper describes Tag Around, a computer game for image tagging. The application is based on a 3D game interface, a game engine that uses a system for automatic image classification and gestural input to play the game. We present the game, how it is used to improve image annotation, the design principles of the interface and the usability tests that were carried out in order to validate the application.

References

1. Datta, R., Joshi, D., Li, J. and Wang, J., Image Retrieval: Ideas, Influences, and Trends of the New Age. in ACM Computing Surveys, (2008).
2. Gonçalves, D., Jesus R., Correia, N., A Gesture Based Game for Image Tagging. Extented Abstract in ACM Conference on Human Factors in Computing Systems (CHI 2008), pp. 2685--2690, 2008.
3. Guo, G., Li, S., Chan, K., Face Recognition by Support Vector Machines. in Fourth IEEE International Conference on Automatic Face and Gesture Recognition, (2000), 196.
4. Jesus, R., Gonçalves, D., Abrantes, A., Correia, N. Playing Games as a Way to Improve Automatic Image Annotation. In Proceedings of the IEEE International Workshop on Semantic Learning Applications in Multimedia (SLAM08), in CVPR08 (2008).
5. Tuulos, V., Scheible, J. and Nyholm, H., Combining Web, Mobile Phones and Public Displays in Large-Scale: Manhattan Story Mashup. In Proceedings of Pervasive Computing 07, (2007).
6. von Ahn, L., Dabbish, L. Labeling images with a computer game. In Proceedings of the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI '04 (2004).
7. Wenyin, L., Dumais, S., Sun, Y., Zhang, H., Czerwinski, M., Field, B. Semi-Automatic Image Annotation. In Proceedings of the Human-Computer Interaction-Interact '01 (2001).

Index Terms

• Applied computing

  • Computers in other domains

    • Personal computers and PC applications

      • Computer games

• Human-centered computing

  • Human computer interaction (HCI)

    • HCI design and evaluation methods

• Information systems

  • Information systems applications

    • Multimedia information systems

      • Massively multiplayer online games

• Software and its engineering

  • Software organization and properties

    • Contextual software domains

      • Virtual worlds software

        • Interactive games