Clarification dialogues in human-augmented mapping

ABSTRACT

An approach to dialogue based interaction for resolution of ambiguities encountered as part of Human-Augmented Mapping (HAM) is presented. The paper focuses on issues related to spatial organisation and localisation. The dialogue pattern naturally arises as robots are introduced to novel environments. The paper discusses an approach based on the notion of Questions under Discussion (QUD). The presented approach has been implemented on a mobile platform that has dialogue capabilities and methods for metric SLAM. Experimental results from a pilot study clearly demonstrate that the system can resolve problematic situations.

REFERENCES

• 1: James Allen , Donna Byron , Myroslava Dzikovska , George Ferguson , Lucian Galescu , Amanda Stent, An architecture for a generic dialogue shell, Natural Language Engineering, v.6 n.3-4, p.213-228, September 2000
• 2: Nicholas Asher and Alex Lascarides. Logics of Conversation. Cambridge University Press, 2003.
• 3: Jason Baldridge , Geert-Jan M. Kruijff, Multi-modal combinatory categorial grammar, Proceedings of the tenth conference on European chapter of the Association for Computational Linguistics, April 12-17, 2003, Budapest, Hungary [doi>10.3115/1067807.1067836]
• 4: Johan Bos , Ewan Klein , Tetsushi Oka, Meaningful conversation with a mobile robot, Proceedings of the tenth conference on European chapter of the Association for Computational Linguistics, April 12-17, 2003, Budapest, Hungary [doi>10.3115/1067737.1067751]
• 5: David J. Bruemmer , Julie L. Marble , Donald D. Dudenhoeffer , Matthew O. Anderson , Mark D. McKay, Mixed-Initiative Control for Remote Characterization of Hazardous Environments, Proceedings of the 36th Annual Hawaii International Conference on System Sciences (HICSS'03) - Track 5, p.127.1, January 06-09, 2003
• 6: D.J. Bruemmer and M. Walton. Collaborative tools for mixed teams of humans and robots. In Proc. of the Workshop on Multi-Robot Systems, Washington, D.C., 2003.
• 7: Adam Cheyer , David Martin, The Open Agent Architecture, Autonomous Agents and Multi-Agent Systems, v.4 n.1-2, p.143-148, March-June 2001
• 8: A. Diosi, G. Taylor, and L. Kleeman. Interactive SLAM using laser and advanced sonar. In Proc. of the IEEE International Conference on Robotics and Automation (ICRA'05), Barcelona,Spain, April 2005.
• 9: John Folkesson, Patric Jensfelt, and Henrik Christensen. Vision SLAM in the measurement subspace. In Proc. of the IEEE International Conference on Robotics and Automation (ICRA'05), 2005.
• 10: C. Galindo, A. Saffiotti, S. Coradeschi, P. Buschka, J.A. Fernández-Madrigal, and J.Gonález. Multi-hierarchical semantic maps for mobile robotics. In Proc. of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'05), pages 3492--3497, 2005.
• 11: A. Haasch, S. Hohenner, S. Huewel, M. Kleinehagenbrock, S. Lang, I. Toptsis, G. A. Fink, J. Fritsch, B. Wrede, and G. Sagerer. Biron - the Bielefeld robot companion. In E. Prassler, G. Lawitzky, P. Fiorini, and M. Haegele, editors, Proc. Int. Workshop on Advances in Service Robotics, pages 27--32, Stuttgart, Germany, 2004. Fraunhofer IRB Verlag.
• 12: H. Ishiguro, T. Ono, M. Imai, T. Maeda, T. Kanda, and R. Nakatsu. Robovie: an interactive humanoid robot. Int. J. Industrial Robotics, 28(6):498--503, 2001.
• 13: Geert-Jan M. Kruijff. A Categorial-Modal Logical Architecture of Informativity: Dependency Grammar Logic & Information Structure. PhD thesis, Faculty of Mathematics and Physics, Charles University, Prague, Czech Republic, 2001.
• 14: Geert-Jan M. Kruijff. Contextually appropriate utterance planning for CCG. In Proc. of the 9th European Workshop on Natural Language Generation, Abderdeen, Scotland, 2005.
• 15: Staffan Larsson. Issue-Based Dialogue Management. Phd thesis, Department of Linguistics, Göteborg University, Göteborg, Sweden, 2002.
• 16: David G. Lowe, Distinctive Image Features from Scale-Invariant Keypoints, International Journal of Computer Vision, v.60 n.2, p.91-110, November 2004 [doi>10.1023/B:VISI.0000029664.99615.94]
• 17: Julie L. Marble , David J. Bruemmer , Douglas A. Few , Donald D. Dudenhoeffer, Evaluation of Supervisory vs. Peer-Peer Interaction with Human-Robot Teams, Proceedings of the Proceedings of the 37th Annual Hawaii International Conference on System Sciences (HICSS'04) - Track 5, p.50130.2, January 05-08, 2004
• 18: P. Newman, J. Leonard, J.D. Tardós, and J. Neira. Explore and return: Experimental validation of real-time concurrent mapping and localization. In Proc. of the IEEE International Conference on Robotics and Automation (ICRA'02), pages 1802--1809, Washington D.C., USA, 2002.
• 19: Axel Rottmann, Oscar Martinez Mozos, Cyrill Stachniss, and Wolfram Burgard. Semantic place classification of indoor environments with mobile robots using boosting. In Proc. of the National Conference on Artificial Intelligence, Pittsburgh, PA, July 2005. AAAI.
• 20: Candace L. Sidner , Cory D. Kidd , Christopher Lee , Neal Lesh, Where to look: a study of human-robot engagement, Proceedings of the 9th international conference on Intelligent user interface, January 13-16, 2004, Funchal, Madeira, Portugal [doi>10.1145/964442.964458]
• 21: Aaron Sloman. Beyond shallow models of emotion. Cognitive Processing, 2(1):177--198, 2001.
• 22: E.A. Topp and H.I. Christensen. Tracking for following and passing persons. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'05), pages 70--76, 2005.
• 23: W. Wahlster. Smartkom: Fusion and fission of speech, gestures, and facial expressions. In Proceedings of the 1st International Workshop on Man-Machine Symbiotic Systems, pages 213--225, Kyoto, Japan, 2002.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.7 Natural Language Processing

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.9 Robotics

General Terms:
Algorithms

Keywords:
clarification, human-augmented mapping, mixed initiative, natural language dialogue