Article

Clarification dialogues in human-augmented mapping

Authors:

Geert-Jan M. Kruijff,

Hendrik Zender,

Patric Jensfelt,

Henrik I. ChristensenAuthors Info & Claims

HRI '06: Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction

Pages 282 - 289

https://doi.org/10.1145/1121241.1121290

Published: 02 March 2006 Publication History

Abstract

An approach to dialogue based interaction for resolution of ambiguities encountered as part of Human-Augmented Mapping (HAM) is presented. The paper focuses on issues related to spatial organisation and localisation. The dialogue pattern naturally arises as robots are introduced to novel environments. The paper discusses an approach based on the notion of Questions under Discussion (QUD). The presented approach has been implemented on a mobile platform that has dialogue capabilities and methods for metric SLAM. Experimental results from a pilot study clearly demonstrate that the system can resolve problematic situations.

References

[1]

James Allen, Donna Byron, Myroslava Dzikovska, George Ferguson, Lucian Galescu, and Amanda Stent. An architecture for a generic dialogue shell. Journal of Natural Language Engineering, 6(3):1--16, 2000.

Digital Library

[2]

Nicholas Asher and Alex Lascarides. Logics of Conversation. Cambridge University Press, 2003.

[3]

Jason Baldridge and Geert-Jan M. Kruijff. Multi-modal combinatory categorial grammmar. In Proceedings of EACL'03, Budapest, Hungary, 2003.

Digital Library

[4]

J. Bos, E. Klein, and T. Oka. Meaningful conversation with a mobile robot. In Proceedings of the Research Note Sessions of the 10th Conference of the European Chapter of the Association for Computational Linguistics (EACL'03), Budapest, Hungary, 2003.

Digital Library

[5]

D. J. Bruemmer, J. L. Marble, D. D. Dudenhoeffer, M. O. Anderson, and M. D. McKay. Mixed-initiative control for remote characterization of hazardous environments. In Proc. of Hawaiian International Conference on Computer Science 2003, Waikoloa Village, Hawaii, 2003.

Digital Library

[6]

D.J. Bruemmer and M. Walton. Collaborative tools for mixed teams of humans and robots. In Proc. of the Workshop on Multi-Robot Systems, Washington, D.C., 2003.

[7]

Adam Cheyer and David Martin. The open agent architecture. Journal of Autonomous Agents and Multi-Agent Systems, 4(1):143--148, March 2001.

Digital Library

[8]

A. Diosi, G. Taylor, and L. Kleeman. Interactive SLAM using laser and advanced sonar. In Proc. of the IEEE International Conference on Robotics and Automation (ICRA'05), Barcelona,Spain, April 2005.

[9]

John Folkesson, Patric Jensfelt, and Henrik Christensen. Vision SLAM in the measurement subspace. In Proc. of the IEEE International Conference on Robotics and Automation (ICRA'05), 2005.

[10]

C. Galindo, A. Saffiotti, S. Coradeschi, P. Buschka, J.A. Fernández-Madrigal, and J.Gonález. Multi-hierarchical semantic maps for mobile robotics. In Proc. of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'05), pages 3492--3497, 2005.

[11]

A. Haasch, S. Hohenner, S. Huewel, M. Kleinehagenbrock, S. Lang, I. Toptsis, G. A. Fink, J. Fritsch, B. Wrede, and G. Sagerer. Biron - the Bielefeld robot companion. In E. Prassler, G. Lawitzky, P. Fiorini, and M. Haegele, editors, Proc. Int. Workshop on Advances in Service Robotics, pages 27--32, Stuttgart, Germany, 2004. Fraunhofer IRB Verlag.

[12]

H. Ishiguro, T. Ono, M. Imai, T. Maeda, T. Kanda, and R. Nakatsu. Robovie: an interactive humanoid robot. Int. J. Industrial Robotics, 28(6):498--503, 2001.

[13]

Geert-Jan M. Kruijff. A Categorial-Modal Logical Architecture of Informativity: Dependency Grammar Logic & Information Structure. PhD thesis, Faculty of Mathematics and Physics, Charles University, Prague, Czech Republic, 2001.

[14]

Geert-Jan M. Kruijff. Contextually appropriate utterance planning for CCG. In Proc. of the 9th European Workshop on Natural Language Generation, Abderdeen, Scotland, 2005.

[15]

Staffan Larsson. Issue-Based Dialogue Management. Phd thesis, Department of Linguistics, Göteborg University, Göteborg, Sweden, 2002.

[16]

D. G. Lowe. Distinctive image features from scale-invariant keypoints. In Int. Jnl. Computer Vision, pages 91--110, 2004.

Digital Library

[17]

J.L. Marble, D.J. Bruemmer, and D.D. Dudenhoeffer D.A. Few. Evaluation of supervisory vs. peer-peer interaction with human-robot teams. In Proc. of the Hawaiin International Conference on Computer Science, 2004.

Digital Library

[18]

P. Newman, J. Leonard, J.D. Tardós, and J. Neira. Explore and return: Experimental validation of real-time concurrent mapping and localization. In Proc. of the IEEE International Conference on Robotics and Automation (ICRA'02), pages 1802--1809, Washington D.C., USA, 2002.

[19]

Axel Rottmann, Oscar Martinez Mozos, Cyrill Stachniss, and Wolfram Burgard. Semantic place classification of indoor environments with mobile robots using boosting. In Proc. of the National Conference on Artificial Intelligence, Pittsburgh, PA, July 2005. AAAI.

Digital Library

[20]

C.L. Sidner, C.D. Kidd, C.H. Lee, and N.B. Lesh. Where to look: A study of human-robot engagement. In Proceedings of the ACM International Conference on Intelligent User Interfaces (IUI), pages 78--84, 2004.

Digital Library

[21]

Aaron Sloman. Beyond shallow models of emotion. Cognitive Processing, 2(1):177--198, 2001.

[22]

E.A. Topp and H.I. Christensen. Tracking for following and passing persons. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'05), pages 70--76, 2005.

[23]

W. Wahlster. Smartkom: Fusion and fission of speech, gestures, and facial expressions. In Proceedings of the 1st International Workshop on Man-Machine Symbiotic Systems, pages 213--225, Kyoto, Japan, 2002.

Cited By

Xu JZhang HSi QLi YLan XKong T(2024)Towards Unified Interactive Visual Grounding in The Wild2024 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA57147.2024.10611354(3288-3295)Online publication date: 13-May-2024
https://doi.org/10.1109/ICRA57147.2024.10611354
Zhang HXu JMo YKong T(2024)InViG: Benchmarking Open-Ended Interactive Visual Grounding with 500K Dialogues2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)10.1109/CVPRW63382.2024.00560(5508-5518)Online publication date: 17-Jun-2024
https://doi.org/10.1109/CVPRW63382.2024.00560
Mo YZhang HKong T(2023)Towards Open-World Interactive Disambiguation for Robotic Grasping2023 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA48891.2023.10161333(8061-8067)Online publication date: 29-May-2023
https://doi.org/10.1109/ICRA48891.2023.10161333
Show More Cited By

Index Terms

Clarification dialogues in human-augmented mapping
1. Computer systems organization
  1. Embedded and cyber-physical systems
    1. Robotics
2. Computing methodologies
  1. Artificial intelligence

Recommendations

Clarification Dialogues for Perception-based Errors in Situated Human-Computer Dialogues
MMRWHRI '14: Proceedings of the 2014 Workshop on Multimodal, Multi-Party, Real-World Human-Robot Interaction

We present an experiment about situated human-computer interaction. Participants interacted with a simulated robot system to complete a series of tasks in a situated environment. Errors were introduced into the robot's perception to produce ...
An Analysis of Mixed Initiative and Collaboration in Information-Seeking Dialogues
SIGIR '20: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval

The ability to engage in mixed-initiative interaction is one of the core requirements for a conversational search system. How to achieve this is poorly understood. We propose a set of unsupervised metrics, termed ConversationShape, that highlights the ...
User-Tailored Planning of Mixed Initiative Information-Seeking Dialogues

Intelligent dialogue systems usually concentrate on user support at the level of the domain of discourse, following a plan-based approach. Whereas this is appropriate for collaborative planning tasks, the situation in interactive information retrieval ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '06: Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction

March 2006

376 pages

ISBN:1595932941

DOI:10.1145/1121241

General Chair:
Michael A. Goodrich
Brigham Young University USA
,
Program Chairs:
Alan C. Schultz
Naval Research Laboratory, USA
,
David J. Bruemmer
Idaho National Laboratory, USA

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 March 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

HRI06

Sponsor:

HRI06: International Conference on Human Robot Interaction

March 2 - 3, 2006

Utah, Salt Lake City, USA

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

40
Total Citations
View Citations
404
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)1

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Xu JZhang HSi QLi YLan XKong T(2024)Towards Unified Interactive Visual Grounding in The Wild2024 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA57147.2024.10611354(3288-3295)Online publication date: 13-May-2024
https://doi.org/10.1109/ICRA57147.2024.10611354
Zhang HXu JMo YKong T(2024)InViG: Benchmarking Open-Ended Interactive Visual Grounding with 500K Dialogues2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)10.1109/CVPRW63382.2024.00560(5508-5518)Online publication date: 17-Jun-2024
https://doi.org/10.1109/CVPRW63382.2024.00560
Mo YZhang HKong T(2023)Towards Open-World Interactive Disambiguation for Robotic Grasping2023 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA48891.2023.10161333(8061-8067)Online publication date: 29-May-2023
https://doi.org/10.1109/ICRA48891.2023.10161333
Crespo JCastillo JMozos OBarber R(2020)Semantic Information for Robot Navigation: A SurveyApplied Sciences10.3390/app1002049710:2(497)Online publication date: 9-Jan-2020
https://doi.org/10.3390/app10020497
Bateman JPomarlan MKazhoyan G(2019)Embodied contextualization: Towards a multistratal ontological treatmentApplied Ontology10.3233/AO-190218(1-35)Online publication date: 2-Oct-2019
https://doi.org/10.3233/AO-190218
Williams TYazdani FSuresh PScheutz MBeetz M(2019)Dempster-Shafer theoretic resolution of referential ambiguityAutonomous Robots10.1007/s10514-018-9795-543:2(389-414)Online publication date: 1-Feb-2019
https://dl.acm.org/doi/10.1007/s10514-018-9795-5
Kragic DGustafson JKaraoguz HJensfelt PKrug R(2018)Interactive, collaborative robotsProceedings of the 27th International Joint Conference on Artificial Intelligence10.5555/3304415.3304419(18-25)Online publication date: 13-Jul-2018
https://dl.acm.org/doi/10.5555/3304415.3304419
Vanzo APart JYu YNardi DLemon OAndre EKoenig SDastani MSukthankar G(2018)Incrementally Learning Semantic Attributes through Dialogue InteractionProceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems10.5555/3237383.3237829(865-873)Online publication date: 9-Jul-2018
https://dl.acm.org/doi/10.5555/3237383.3237829
Cosgun AChristensen H(2018)Context-aware robot navigation using interactively built semantic mapsPaladyn, Journal of Behavioral Robotics10.1515/pjbr-2018-00209:1(254-276)Online publication date: 6-Sep-2018
https://doi.org/10.1515/pjbr-2018-0020
Liu SXing QHan YZhao YLi R(2017)Speech recognition based building semantic map method on Aldebaran Nao2017 29th Chinese Control And Decision Conference (CCDC)10.1109/CCDC.2017.7979119(3539-3543)Online publication date: May-2017
https://doi.org/10.1109/CCDC.2017.7979119
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten