skip to main content
10.1145/1810617.1810623acmconferencesArticle/Chapter ViewAbstractPublication PageshtConference Proceedingsconference-collections
research-article

A semiotic approach for the generation of themed photo narratives

Published:13 June 2010Publication History

ABSTRACT

A wide variety of systems could be considered 'narrative systems', either directly working towards generating rich narratives or, more frequently, because they present or handle information in a narrative context. These narratives, generated or otherwise handled, may contain themes; an essential part of the subtext of narrative communicating important concepts outside the capabilities of the literal meaning of the content and forming the thematic cohesion that aids the flow of the presented narrative. However despite this very little work has been undertaken to understand of take advantage of these themes, particularly in narrative generation where the presence of well defined themes may improve the richness of those generated narratives. In this paper we evaluate the performance of a system utilising a thematic model in order to generate simple narratives in the form of photo montages compared to a keyword based system that does not. The experiment demonstrates that the system utilising the thematic model is capable of successfully connoting themes within these narratives. It also shows that the relevance of the resulting narratives to the titles used to generate them is higher in the thematic system than those generated by the other system.

References

  1. M. Alberink, L. Rutledge, and M. Veenstra. Sequence and emphasis in automated domain-independent discourse generation. In Information systems, pages 1--10, 2003.Google ScholarGoogle Scholar
  2. M. Bal. Narratology: Introduction to the Theory of Narrative. University of Toronto Press, January 1998.Google ScholarGoogle Scholar
  3. R. Barthes. Mythologies. Editions du Seuil, 1957.Google ScholarGoogle Scholar
  4. R. Barthes and L. Duisit. An introduction to the structural analysis of narrative. New Literary History, 6:237--272, 1975.Google ScholarGoogle ScholarCross RefCross Ref
  5. W. Booth. The Rhetoric of Fiction, chapter Types of Narration, pages 69--74. University of Chicago Press, 1974.Google ScholarGoogle Scholar
  6. P. D. Bra, A. Aerts, B. Berden, B. de Lange, B. Rousseau, T. Santic, D. Smits, and N. Stash. Aha! the adaptive hypermedia architecture. In Proceedings of the fourteenth ACM conference on Hypertext and hypermedia, pages 81--84, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. P. D. Bra, P. Brusilovsky, and G.-J. Houben. Adaptive hypermedia: from systems to framework. In ACM Computing Surveys (CSUR), volume 31, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. C. Buckley. Automatic query expansion using smart: Trec 3. In In Proceedings of The third Text REtrieval Conference (TREC-3), pages 69--80, 1995.Google ScholarGoogle Scholar
  9. S. E. Buscaldi D., Rosso P. A wordnet-based query expansion method for geographical information retrieval. In: CLEF 2005 Working Notes, 21-23 September 2005. Vienna, Austria C. Peters (Ed.).Google ScholarGoogle Scholar
  10. L. Calvi. "lector in rebus": the role of the reader and the characteristics of hyperreading. In HYPERTEXT '99: Proceedings of the tenth ACM Conference on Hypertext and hypermedia: returning to our diverse roots, pages 101--109, New York, NY, USA, 1999. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. M. Cavazza, F. Charles, and S. J. Mead. AgentsŠ interaction in virtual storytelling. In Intelligent Virtual Agents, Springer Lecture Notes in Artificial Intelligence 2190, pages 156--170. Springer-Verlag, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. C. Hargood, D. Millard, and M. Weal. A thematic approach to emerging narrative structure. In Web Science at Hypertext08, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. C. Hargood, D. Millard, and M. Weal. Investigating a thematic approach to narrative generation. In DAH at Hypertext 09, 2009.Google ScholarGoogle Scholar
  14. C. Hargood, D. Millard, and M. Weal. Using a thematic model to enrich photo montages. In Proceedings of Hypertext 09, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. M. Lebowitz. Planning stories. In Program of the Ninth Annual Conference of the Cognitive Science Society, volume 9, pages 234--241, Seattle, Washington, 1987. Cognitive Science Scoiety Conference.Google ScholarGoogle Scholar
  16. R. Mandala, R. M, T. Tokunaga, and H. Tanaka. Combining multiple evidence from different types of thesaurus for query expansion, 1999.Google ScholarGoogle Scholar
  17. M. Mateas and A. Stern. Façade: An experiment in building a fully-realized interactive drama. In Game Developers Conference, 2003.Google ScholarGoogle Scholar
  18. M. McQuillan. The Narrative Reader. Routledge, London, 2000.Google ScholarGoogle Scholar
  19. J. R. Meehan. Tale-spin, an interactive program that writes stories. In In Proceedings of the Fifth International Joint Conference on Artificial Intelligence, pages 91--98, 1977. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. G. Miller. Wordnet: An on-line lexical database. International Journal of Lexicography, 3(4), 1990.Google ScholarGoogle ScholarCross RefCross Ref
  21. H. J. Peat and P. Willett. The limitations of term co-occurrence data for query expansion in document retrieval systems. Journal of the American Society for Information Science, 42:378--383, 1991.Google ScholarGoogle ScholarCross RefCross Ref
  22. M. O. Riedl and R. M. Young. Character-focused narrative generation for execution in virtual worlds. In Proceedings of the International Conference on Virtual Storytelling, pages 47--56, 2003.Google ScholarGoogle ScholarCross RefCross Ref
  23. F. Saussure, C. Bally, A. Sechehaye, and A. Riedlinger. Course in General Linguistics. McGraw-Hill, 1966. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. M. Theune, S. Faas, A. Nijholt, and D. Heylen. The virtual storyteller: Story creation by intelligent agents. In TIDSE 2003: Technologies for Interactive Digital Storytelling and Entertainment, 2003.Google ScholarGoogle Scholar
  25. B. Tomashevsky. Russian Formalist Criticism: Four Essays, chapter Thematics, pages 66--68. University of Nebraska Press, 1965.Google ScholarGoogle Scholar
  26. M. Tuffield, S. Harris, D. P. Dupplaw, A. Chakravarthy, C. Brewster, N. Gibbins, K. O'Hara, F. Ciravegna, D. Sleeman, Y. Wilks, and N. R. Shadbolt. Image annotation with photocopain. In First International Workshop on Semantic Web Annotations for Multimedia (SWAMM 2006) at WWW2006, Edinburgh, United Kingdom., 2006.Google ScholarGoogle Scholar
  27. E. M. Voorhees. Query expansion using lexical-semantic relations. In SIGIR '94: Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, pages 61--69, New York, NY, USA, 1994. Springer-Verlag New York, Inc. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. M. Weal, H. Alani, S. Kim, P. Lewis, D. Millard, P. Sinclair, D. D. Roure, and N. Shadbolt. Ontologies as facilitators for repurposing web documents. International Journal of Human-Computer Studies, 65:537--562, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. J. Xu and W. B. Croft. Query expansion using local and global document analysis. In SIGIR '96: Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval, pages 4--11, New York, NY, USA, 1996. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. X. S. Zhou and T. S. Huang. Unifying keywords and visual contents in image retrieval. IEEE MultiMedia, 9(2):23--33, 2002. Key word paper, keyword searching for images, appending relevant keywords to query expansion, effectiveness of keyword searching. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. A semiotic approach for the generation of themed photo narratives

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        HT '10: Proceedings of the 21st ACM conference on Hypertext and hypermedia
        June 2010
        328 pages
        ISBN:9781450300414
        DOI:10.1145/1810617

        Copyright © 2010 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 13 June 2010

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        Overall Acceptance Rate378of1,158submissions,33%

        Upcoming Conference

        HT '24
        35th ACM Conference on Hypertext and Social Media
        September 10 - 13, 2024
        Poznan , Poland

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader