Multimedia with a speech track: searching spontaneous conversational speech

Abstract

After two successful years at SIGIR in 2007 and 2008, the third workshop on Searching Spontaneous Conversational Speech (SSCS 2009) was held conjunction with the ACM Multimedia 2009. The goal of the SSCS series is to serve as a forum that brings together the disciplines that collaborate on spoken content retrieval, including information retrieval, speech recognition and multimedia analysis. Multimedia collections often contain a speech track, but in many cases it is ignored or not fully exploited for information retrieval. Currently, spoken content retrieval research is expanding beyond highly-conventionalized domains such as broadcast news in to domains involving speech that is produced spontaneously and in conversational settings. Such speech is characterized by wide variability of speaking styles, subject matter and recording conditions. The work presented at SSCS 2009 included techniques for searching meetings, interviews, telephone conversations, podcasts and spoken annotations. The work encompassed a large range of approaches including using subword units, exploiting dialogue structure, fusing retrieval models, modeling topics and integrating visual features. Taken in sum, the workshop demonstrated the high potential of new ideas emerging in the area of speech search and also reinforced the need for concentrated research devoted to the classic challenges of spoken content retrieval, many of which remain yet unsolved.

References

1. F.M.G. de Jong, D. Oard, R. Ordelman, and S. Raaijmakers. Searching spontaneous conversational speech. SIGIR Forum, 41(2):104--108, 2007.
2. G. Friedland, L. Gottlieb, and A. Janin. Joke-o-mat: Browsing sitcoms punchline by punchline. In MM '09: Proceedings of the 17th ACM international conference on Multimedia, pages 1115--1116, New York, NY, USA, 2009. ACM.
3. W. Heeren, L. van der Werff, R. Ordelman, A. van Hessen, and F. de Jong. Radio Oranje: Searching the Queen's speech(es). In SIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, pages 903--903, New York, NY, USA, 2007. ACM.
4. J. Kohler, M. Larson, F.M.G. de Jong, W. Kraaij, and R.J.F. Ordelman. Spoken content retrieval: Searching spontaneous conversational speech. SIGIR Forum, 42(2):66--75, 2008.
5. M. Larson, R.J.F. Ordelman, F.M.G. de Jong, W. Kraaij, and J. Kohler. Searching multimedia content with a spontaneous conversational speech track. In MM '09: Proceedings of the 17th ACM international conference on Multimedia, pages 1159--1160, New York, NY, USA, 2009. ACM.
6. S. Rudinac, M. Larson, and A. Hanjalic. Exploiting visual reranking to improve pseudorelevance feedback for spoken-content-based video retrieval. In Image Analysis for Multimedia Interactive Services, 2009. WIAMIS '09. 10th Workshop on, pages 17--20, 2009.
7. F. Seide, K. Thambiratnam, L. Lu, and R. P. Yu. Multimedia retrieval through indexing speech: An enterprise perspective. In SSCS '09: Proceedings of the third workshop on Searching spontaneous conversational speech, pages 1--2, New York, NY, USA, 2009. ACM.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

• Information systems

  • Information retrieval