House of Ads: a Multiplayer Action Game for Annotating Ad Video Content

ABSTRACT

Content-based search in a large collection of media is a task that cannot be fully automated. Semantic annotations provided by humans through crowdsourcing techniques can be attached to media elements in the form of metadata and be used by search engines to provide the required results. However, the manual annotation of large collections is a tedious and time-consuming process and proper incentives need to be provided to attract contributors. Games with a purpose, or human computation games are based on the idea that people could solve computational tasks while playing online games. Numerous such games have been created and used in various areas, including media annotation. However, the majority of them contain limited game elements and the main challenge is the annotation task itself. This paper presents the design, implementation and early evaluation of a human computation game for supporting creative advertising. The game is part of a larger project for data mining and content-based searching in a rich collection of video ads aiming to serve as a creativity support tool for advertisers. Its main aim is to have players populate an ontology whilst playing a multiplayer game that includes an action and a quiz gameplay mode. The game incorporates a variety of elements and challenges found in modern action games and uses a metaphor of rooms and collectible items to represent the ontology concepts in the game world. The pilot study results indicate that players found the concept interesting, but there is still room for improvements in the gameplay and appearance.

References

1. Ahn, L. Von 2006. Games with a purpose. Computer. 39, 6, 96--98.
2. Aitken, R., Gray, B., and Lawson, R. 2008. Advertising effectiveness from a consumer perspective. International Journal of Advertising 27(2), 279--297.
3. Amos, C, Holmes, G., and Strutton, D. 2008. Exploring the relationship between celebrity endorser effects and advertising effectiveness: A quantitative synthesis of effect size. International Journal of Advertising, 27(2), 209--234.
4. Blasko, V. and Mokwa, M. 1986. Creativity in advertising: A Janusian perspective. Journal of Advertising, 15(4), 43--72.
5. Burke, R.R., Rangaswamy, A., Wind, J., and Eliashberg, J. 1990. A Knowledge-Based System for Advertising Design. Marketing Science. 9, 3, 212--229.
6. Carranza, J. and Krause, M. 2012. Evaluation of game designs for human computation. AAAI Workshop - Technical Report. WS-12-17, (2012), 9--15.
7. Chen, Z. 2010. Computational intelligence for decision support, CRC Press (2010).
8. Cuel, R. et al. 2011. Motivation mechanisms for participation in human-driven semantic content creation. International Journal of Knowledge Engineering and Data Mining. 1, 4 (2011), 331.
9. ESA 2014. Annual Report.
10. Goldenberg, J., Mazursky, D., and Solomon, S. 1999. The fundamental templates of quality ads. Marketing science, 18(3), 333--351.
11. Hill, R. and Johnson, L. 2004. Understanding creative service: a qualitative study of the advertising problem delineation, communication and response (APDCR) process. International Journal of Advertising, 23(3), 285--307.
12. Ho, C., Chang, T. H., Lee, J. C., Hsu, J. Y. J., and Chen, K. T. 2009. KissKissBan: a competitive human computation game for image annotation. Proceedings of the ACM SIGKDD Workshop on Human Computation - HCOMP '09. (2009), 11.
13. Ho, C., Chang, T. H., and Hsu, J. Y. J. 2007. Photoslap: A multi-player online game for semantic annotation. Proceedings of the National Conference on Artificial Inteligence. 22, (2007), 1359.
14. Hu, W., Xie, N., Li, L., Zeng, X., & Maybank, S. 2011. A survey on visual content-based video indexing and retrieval. IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews. 41, 6 (2011), 797--819.
15. Kermanidis, K. and Maragoudakis, M. 2013. Designing a Support Tool for Creative Advertising by Mining Collaboratively Tagged Ad Video Content: The Architecture of PromONTotion. Artificial Intelligence Applications and Innovations. Springer Berlin Heidelberg, 2013. 10--19.
16. Krause, M., Takhtamysheva, A., Wittstock, M., and Malaka, R. 2010. Frontiers of a Paradigm -- Exploring Human Computation with Digital Games. Proceedings of the ACM SIGKDD Workshop on Human Computation (HCOMP). (2010), 22--25.
17. Law, E. and von Ahn, L. 2009. Input-agreement: a new mechanism for collecting data using human computation games. Proceedings of the 27th international conference on Human factors in computing systems - CHI 09. (2009), 1197--1206.
18. Law, E.L.M., Von Ahn, L., Dannenberg, R. B., and Crawford, M. 2007. Tagatune : a Game for Music and Sound Annotation. In International Conference on Music Information Retrieval (ISMIR'07). (2007), 361--364.
19. MacCrimmon, K. and Wagner, C. 1994. Stimulating ideas through creative software. Management Science, 40(11), 1514--1532.
20. Maragoudakis, M., Kermanidis, K. L., and Vosinakis, S. 2014. Extracting Knowledge from Collaboratively Annotated Ad Video Content. Artificial Intelligence Applications and Innovations (pp. 85--95). Springer Berlin Heidelberg.
21. Opas, T. 2008. An investigation into the development of a Creativity Support Tool for advertising. (2008).
22. Pe-Than, E.P.P., Goh, D. H. L., and Lee, C. S. 2012. A survey and typology of human computation games. Proceedings of the 9th International Conference on Information Technology, ITNG 2012. May 2015 (2012), 720--725.
23. Rollings, A. and Adams, E. 2003. Andrew Rollings and Ernest Adams on game design. New Riders.
24. Rollings, A. and Morris, D. 2004. Game architecture and design: a new edition. New Riders.
25. Siorpaes, K. and Hepp, M. 2008. OntoGame: Weaving the semantic web by online games. Lecture Notes in Computer Science 5021 LNCS, (2008), 751--766.
26. Thaler, S., Siorpaes, K., Mear, D., Simperl, E., and Goodman, C. 2011. SeaFish: A game for collaborative and visual image annotation and interlinking. Lecture Notes in Computer Science 6643 LNCS, PART 2 (2011), 466--470.
27. Turnbull, D., Liu, R., Barrington, L., and Lanckriet, G. R. 2007. A Game-Based Approach for Collecting Semantic Annotations of Music. Ismir. (2007), 2--5.
28. Wang, H., Cosley, D., and Fussell, S. R. 2010. Idea Expander: Supporting group brainstorming with conversationally triggered visual thinking stimuli. Proceedings of the 2010 ACM conference on Computer supported cooperative work (pp. 103--106). ACM.

Index Terms

• Applied computing

  • Computers in other domains

    • Personal computers and PC applications

      • Computer games

• Computing methodologies

  • Machine learning

    • Machine learning approaches

      • Neural networks

• Hardware

  • Emerging technologies

    • Circuit substrates

      • Cellular neural networks

• Information systems

  • Information systems applications

    • Multimedia information systems

      • Massively multiplayer online games

• Software and its engineering

  • Software organization and properties

    • Contextual software domains

      • Virtual worlds software

        • Interactive games

• Theory of computation

  • Theory and algorithms for application domains

    • Algorithmic game theory and mechanism design

    • Machine learning theory