skip to main content
10.1145/1347787.1347792acmconferencesArticle/Chapter ViewAbstractPublication PagestapiaConference Proceedingsconference-collections
research-article

Implementation of DomCAT: the domain complexity analysis tool for natural language dialog processing

Published: 14 October 2007 Publication History

Abstract

While dialog system technology is advancing, there is a lack of theory allowing the vastly different domains for systems to be compared. As a result, all predictions of the cost of building a new dialog system must be made by a dialog expert based on intuition and experience. Recently it has been proposed that entropy can be used as a complexity measure for dialog systems. These calculations would require domain specifications and understanding of information theory. This paper introduces the Domain Complexity Analysis Tool, or DomCAT. With this tool, anyone with basic knowledge of dialog systems can calculate system complexities and create new dialog domain specifications, and dialog complexity calculations can become standard for the field.

References

[1]
Allen, J., Ferguson, G., Miller, B., and Ringger, E. Spoken dialogue and interactive planning. Proceedings of the ARPA Spoken Language Systems Technology Workshop (SLST), 1995.
[2]
Bates, M., and Aguso, D. A proposal for incremental dialogue evaluation. Proceedings of the Speech and Natural Language Workshop, 1991, 319--322.
[3]
Charfuelan, M., Lopez, C., Gril J., Rodriguez, C., and Gomez, L. A general framework to assess spoken language dialogue systems: Experience with call center agent systems. Proceedings of the Conference on Natural Language Processing Workshop on Robust Methods in Analysis of Natural Language Data. 2000.
[4]
Frank, G., Guinn, C., and Hubal, R. JUST-TALK: An application of responsive virtual human technology. Proceedings of the 24th Intersevice/Industrial Training, Simulation, and Education Conference, 2002.
[5]
James, F., Rayner, M., and Hockey, B. "Do that again": Evaluating speech dialogue interfaces. Technical Report 00.06, Research Institute for Advanced Computer Science, 2000.
[6]
Keim, G., Fulkerson, M., and Biermann, A. Initiative in tutorial dialogue systems. Proceedings of the American Association for Artificial Intelligence (AAAI) Spring Symposium on Computational Models for Mixed-Initiative Interaction, 1997.
[7]
Pollard, S. Defining the Complexity of Natural Language Dialog System Domains. Ph.D. Thesis, Duke University, Durham, NC, 2006.
[8]
Smith, R. and Hipp, D. Spoken Natural Language Dialog Systems: A Practical Approach. Oxford University Press, NY, 1994.
[9]
Walker, M., Litman, D., Kamm, C., and Abella, A. PARADISE: A framework for evaluating spoken dialogue agents. Proceedings of the 1997 Meeting of the Association for Computational Linguistics and European Chapter of the Association for Computational Linguistics (ACL/EACL), 2000, 28--34.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
TAPIA '07: Proceedings of the 2007 conference on Diversity in computing
October 2007
48 pages
ISBN:9781595938664
DOI:10.1145/1347787
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 October 2007

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. complexity
  2. dialog processing

Qualifiers

  • Research-article

Conference

TAPIA07
Sponsor:
  • ACM
  • IEEE-CS\DATC

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 74
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media