Elements of a spoken language programming interface for robots

ABSTRACT

In many settings, such as home care or mobile environments, demands on users' attention, or users' anticipated level of formal training, or other on-site conditions will make standard keyboard-and monitor-based robot programming interfaces impractical. In such cases, a spoken language interface may be preferable. However, the open-ended task of programming a machine is very different from the sort of closed-vocabulary, data-rich applications (e.g. call routing) for which most speaker-independent spoken language interfaces are designed. This paper will describe some of the challenges of designing a spoken language programming interface for robots, and will present an approach that uses these semantic-level resources as extensively as possible in order to address these challenges.

REFERENCES

• 1: Alfred V. Aho , Jeffrey D. Ullman, The Theory of Parsing, Translation, and Compiling, Prentice Hall Professional Technical Reference, 1972
• 2: G. Aist, J. Allen, E. Campana, L. Galescu, C. A. G. Gallo, S. C. Stoness, M. Swift, and M. Tanenhaus. Software architectures for incremental understanding of human speech. In Proceedings of Interspeech/ICSLP, Pittsburgh, PA, 2006.
• 3: J. Allen and G. Ferguson. Actions and events in interval temporal logic. Journal of Logic and Computation, 4, 1994.
• 4: G. Bugmann, E. Klein, S. Lauria, and T. Kyriacou. Corpus-based robotics : A route instruction example, 2004.
• 5: Thomas Dean , Keiji Kanazawa, A model for reasoning about persistence and causation, Computational Intelligence, v.5 n.3, p.142-150, Aug. 1990
• 6: Jay Earley, An efficient context-free parsing algorithm, Communications of the ACM, v.13 n.2, p.94-102, Feb 1970 [doi>10.1145/362007.362035]
• 7: P. Gorniak and D. Roy. Grounded semantic composition for visual scenes. Journal of Artificial Intelligence Research, 21:429--470, 2004.
• 8: Mark Johnson, Finite-state approximation of constraint-based grammars using left-corner grammar transforms, Proceedings of the 17th international conference on Computational linguistics, August 10-14, 1998, Montreal, Quebec, Canada
• 9: K. P. Murphy and M. A. Paskin. Linear time inference in hierarchical HMMs. In Proceedings of Neural Information Processing Systems, pages 833--840, 2001.
• 10: Manny Rayner , Beth Ann Hockey , Frankie James, A compact architecture for dialogue management based on scripts and meta-outputs, ANLP/NAACL 2000 Workshop on Conversational systems, p.54-60, May 04-04, 2000, Seattle, Washington [doi>10.3115/1117562.1117573]
• 11: S. J. Rosenkrantz and P. M. Lewis, II. Deterministic left corner parser. In IEEE Conference Record of the 11th Annual Symposium on Switching and Automata, pages 139--152, 1970.
• 12: D. Roy and N. Mukherjee. Towards situated speech understanding: Visual context priming of language models. Computer Speech and Language, 19(2):227--248, 2005.
• 13: W. Schuler and T. Miller. Integrating denotational meaning into a DBN language model. In Proceedings of Eurospeech/Interspeech, Lisbon, Portugal, 2005.
• 14: W. Schuler, T. Miller, S. Wu, and A. Exley. Dynamic evidence models in a DBN phone recognizer. In Proceedings of Interspeech/ICSLP, Pittsburgh, PA, 2006.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.7 Natural Language Processing
          Subjects: Language models

General Terms:
Algorithms

Keywords:
human-robot interaction, language modeling, natural language processing, spoken language interfaces