skip to main content
10.1145/1228716.1228748acmconferencesArticle/Chapter ViewAbstractPublication PageshriConference Proceedingsconference-collections
Article

Elements of a spoken language programming interface for robots

Published: 10 March 2007 Publication History

Abstract

In many settings, such as home care or mobile environments, demands on users' attention, or users' anticipated level of formal training, or other on-site conditions will make standard keyboard-and monitor-based robot programming interfaces impractical. In such cases, a spoken language interface may be preferable. However, the open-ended task of programming a machine is very different from the sort of closed-vocabulary, data-rich applications (e.g. call routing) for which most speaker-independent spoken language interfaces are designed. This paper will describe some of the challenges of designing a spoken language programming interface for robots, and will present an approach that uses these semantic-level resources as extensively as possible in order to address these challenges.

References

[1]
A.V. Ahoand, J.D. Ullman. The Theory of Parsing, Translation and Compiling; Volume. I: Parsing. Prentice-Hall, Englewood Cliffs, New Jersey, 1972.
[2]
G. Aist, J. Allen, E. Campana, L. Galescu, C. A. G. Gallo, S. C. Stoness, M. Swift, and M. Tanenhaus. Software architectures for incremental understanding of human speech. In Proceedings of Interspeech/ICSLP, Pittsburgh, PA, 2006.
[3]
J. Allen and G. Ferguson. Actions and events in interval temporal logic. Journal of Logic and Computation, 4, 1994.
[4]
G. Bugmann, E. Klein, S. Lauria, and T. Kyriacou. Corpus-based robotics : A route instruction example, 2004.
[5]
T. Dean and K. Kanazawa. A model for reasoning about persitence and causation. Computational Intelligence, 5(3):142--150, 1989.
[6]
J. Earley. An efficient context-free parsing algorithm. CACM, 13(2):94--102, 1970.
[7]
P. Gorniak and D. Roy. Grounded semantic composition for visual scenes. Journal of Artificial Intelligence Research, 21:429--470, 2004.
[8]
M. Johnson. Finite state approximation of constraint-based grammars using left-corner grammar transforms. In Proceedings of COLING/ACL, pages 619--623, 1998.
[9]
K. P. Murphy and M. A. Paskin. Linear time inference in hierarchical HMMs. In Proceedings of Neural Information Processing Systems, pages 833--840, 2001.
[10]
M. Rayner, B. A. Hockey, and F. James. A compact architecture for dialogue management based on scripts and meta-outputs. In ANLP/NAACL Workshop on Conversational Systems, pages 54--60, Somerset, New Jersey, 2000. Association for Computational Linguistics.
[11]
S. J. Rosenkrantz and P. M. Lewis, II. Deterministic left corner parser. In IEEE Conference Record of the 11th Annual Symposium on Switching and Automata, pages 139--152, 1970.
[12]
D. Roy and N. Mukherjee. Towards situated speech understanding: Visual context priming of language models. Computer Speech and Language, 19(2):227--248, 2005.
[13]
W. Schuler and T. Miller. Integrating denotational meaning into a DBN language model. In Proceedings of Eurospeech/Interspeech, Lisbon, Portugal, 2005.
[14]
W. Schuler, T. Miller, S. Wu, and A. Exley. Dynamic evidence models in a DBN phone recognizer. In Proceedings of Interspeech/ICSLP, Pittsburgh, PA, 2006.

Cited By

View all
  • (2016)Computational Human-Robot InteractionFoundations and Trends in Robotics10.1561/23000000494:2-3(105-223)Online publication date: 20-Dec-2016
  • (2011)An augmented reality system for teaching sequential tasks to a household robot2011 RO-MAN10.1109/ROMAN.2011.6005235(282-287)Online publication date: Jul-2011

Index Terms

  1. Elements of a spoken language programming interface for robots

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    HRI '07: Proceedings of the ACM/IEEE international conference on Human-robot interaction
    March 2007
    392 pages
    ISBN:9781595936172
    DOI:10.1145/1228716
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 10 March 2007

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. human-robot interaction
    2. language modeling
    3. natural language processing
    4. spoken language interfaces

    Qualifiers

    • Article

    Conference

    HRI07
    HRI07: International Conference on Human Robot Interaction
    March 10 - 12, 2007
    Virginia, Arlington, USA

    Acceptance Rates

    HRI '07 Paper Acceptance Rate 22 of 101 submissions, 22%;
    Overall Acceptance Rate 268 of 1,124 submissions, 24%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)4
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 27 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2016)Computational Human-Robot InteractionFoundations and Trends in Robotics10.1561/23000000494:2-3(105-223)Online publication date: 20-Dec-2016
    • (2011)An augmented reality system for teaching sequential tasks to a household robot2011 RO-MAN10.1109/ROMAN.2011.6005235(282-287)Online publication date: Jul-2011

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media