Article

Interaction debugging: an integral approach to analyze human-robot interaction

Authors:

Tijn Kooijmans,

Takayuki Kanda,

Christoph Bartneck,

Hiroshi Ishiguro,

Norihiro HagitaAuthors Info & Claims

HRI '06: Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction

Pages 64 - 71

https://doi.org/10.1145/1121241.1121254

Published: 02 March 2006 Publication History

Abstract

Along with the development of interactive robots, controlled experiments and field trials are regularly conducted to stage human-robot interaction. Experience in this field has shown that analyzing human-robot interaction for evaluation purposes fosters the development of improved systems and the generation of new knowledge. In this paper, we present the interaction debugging approach, which is based on the collection and analysis of data from robots and their environment. Considering the multimodality of robotic technology, often only audio and video are insufficient for detailed analysis of human-robot interaction. Therefore, in our analysis we integrate multimodal information using audio, video, sensory data, and intermediate variables. An important aspect of the interaction debugging approach is using a tool called Interaction Debugger to analyze data. By supporting user-friendly data presentation, annotation and navigation, Interaction Debugger enables fine-grained inspection of human-robot interaction. The main goal of this paper is to address how an integral approach to the analysis of human-robot interaction can be adopted. This is demonstrated by three case studies.

References

[1]

Sakagami, R., Watanabe, C., Aoyama, S., Matsunaga, N., Higaki, N., and Fujimura, K., The intelligent ASIMO: System overview and integration, in Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems, 2002, pp. 2478--2483.

[2]

Fujita, M., AIBO: Toward the era of digital creatures, Int. J. Robot. Res., vol. 20, no. 10, pp. 781--794, 2001.

[3]

Ishiguro, H., Ono, T., Imai, M., Maeda, T., Kanda, T., and Nakatsu, R., Robovie: an interactive humanoid robot", Int. J. Industrial Robot, Vol. 28, No. 6, pp.498--503, 2001.

[4]

Dautenhahn, K. and Werry, I., A Quantitative Technique for Analysing Robot-Human Interactions, in Proc. of the 2002 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, 2002, pp. 1132--1138.

[5]

Kanda, T., Hirano, T., Eaton, D., and Ishiguro, H., Interactive Robots as Social Partners and Peer Tutors for Children: A Field Trial, in Human Computer Interaction, Vol. 19, No. 1-2, pp. 61--84, 2004.

Digital Library

[6]

Siegwart, R., Arras, K.O., Bouabdallah, S., Burnier, D., Froidevaux, G., Greppin, X., Jensen, B., Lorotte, A., Mayor, L., Meisser, M., Philippsen, R., Piguet, R., Ramel, G., Terrien, G., and Tomatis, N., "Robox at Expo.02: A Large-Scale Installation of Personal Robots," in Robotics and Autonomous Systems, vol. 42, issue 3-4, pp. 203--222, 2003.

[7]

Quek, F., Shi, Y., Kirbas, C., and Wu, S., VisSTA: A Tool for Analyzing Multimodal Discourse Data, in Seventh International Conference on Spoken Language Processing, 2002, Denver, CO.

[8]

Kipp, M. and Anvil, A., Generic Annotation Tool for Multimodal Dialogue, in Proceedings of the 7th European Conference on Speech Communication and Technology (Eurospeech), pp. 1367--1370, Aalborg, 2001.

[9]

Kanda, T., Ishiguro, H., Imai, M., and Ono, T., Development and Evaluation of Interactive Humanoid Robots, In Proceedings of the IEEE, 2004, pp. 1839--1850.

[10]

Sumi, Y., Ito, S., Matsuguchi, T., Fels, S., and Mase, K., Collaborative Capturing and Interpretation of Interactions, Pervasive 2004 Workshop on Memory and Sharing of Experiences, pp. 1--7, 2004.

[11]

Nomura, T., Tasaki, T., Kanda, T., Shiomi, M, Ishiguro, H., and Hagita, N., Questionnaire-Based Research on Opinions of Visitors for Communication Robots at an Exhibition in Japan, International Conference on Human-Computer Interaction (Interact 2005), 2005.

Digital Library

[12]

Ekman, P. and Friensen, W. V., Manual for the Facial Action Coding System and Action Unit Photographs, Consulting Psychologists Press, 1978.

[13]

Nabe, S., Kanda, T., Hiraki, K, Ishiguro, H., Kogure, K., and Hagita, N., Analysis of Human Behavior in an Open Field to Improve Communication Robots, Human-Robot Interaction Conference 2006.

Digital Library

[14]

Nabe, S., Kanda, T., Hiraki, K., Ishiguro, H., and Hagita, N., Human Friendship Estimation Model for Communication Robots, 2005 IEEE-RAS International Conference on Humanoid Robots, 2005.

[15]

Preece, J. Rogers, Y., and Sharp, H., "Interaction Design: Beyond Human-Computer Interaction," John Wiley & Sons Inc., New York, chapter 1, 2002.

Digital Library

[16]

Shneiderman, B., Designing the User Interface: Strategies for Effective Human-Computer Interaction, Addison-Wesley Longman, Inc, MA, 1998.

Digital Library

[17]

Norman, D. and Draper, S., User Centered System Design; New Perspectives on Human-Computer Interaction, Lawrence Erlbaum Associates, Inc. Mahwah, NJ, 1986.

Digital Library

Cited By

Tabrez ALuebbers MHayes BPelachaud CTaylor MFaliszewski PMascardi V(2022)Descriptive and Prescriptive Visual Guidance to Improve Shared Situational Awareness in Human-Robot TeamingProceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems10.5555/3535850.3535990(1256-1264)Online publication date: 9-May-2022
https://dl.acm.org/doi/10.5555/3535850.3535990
Lee HCheon ELim CFischer K(2022)Configuring Humans: What Roles Humans Play in HRI Research2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889496(478-492)Online publication date: 7-Mar-2022
https://doi.org/10.1109/HRI53351.2022.9889496
Szafir DSzafir DBethel CPaiva ABroadbent EFeil-Seifer DSzafir D(2021)Connecting Human-Robot Interaction and Data VisualizationProceedings of the 2021 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3434073.3444683(281-292)Online publication date: 8-Mar-2021
https://dl.acm.org/doi/10.1145/3434073.3444683
Show More Cited By

Index Terms

Interaction debugging: an integral approach to analyze human-robot interaction
1. Applied computing
  1. Law, social and behavioral sciences
    1. Psychology
2. Computing methodologies
  1. Artificial intelligence
    1. Computer vision

Recommendations

3-D interaction with a large wall display using transparent markers
AVI '10: Proceedings of the International Conference on Advanced Visual Interfaces

In this paper we proposed a new interface for interacting with large displays via small video devices such as a cell phone. We estimate the location of the camera relative to the display using a matrix of transparent markers embedded on display. As a ...
Interaction Proxemics: Combining Physical Spaces for Seamless Gesture Interaction
PerDis '15: Proceedings of the 4th International Symposium on Pervasive Displays

Touch and gesture input have become popular for display interaction. While applications usually focus on one particular input technology, we set out to adjust the interaction modality based on the proximity of users to the screen. Therefore, we built a ...
Adding obstacle avoidance to a robotic platform for human robot interaction
PETRA '13: Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments

In this paper, we describe the development and current state of an inexpensive platform for educational purposes and research in human robot interaction. The platform is based on the ubiquitous LabVIEW programming language and an in-house developed two ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '06: Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction

March 2006

376 pages

ISBN:1595932941

DOI:10.1145/1121241

General Chair:
Michael A. Goodrich
Brigham Young University USA
,
Program Chairs:
Alan C. Schultz
Naval Research Laboratory, USA
,
David J. Bruemmer
Idaho National Laboratory, USA

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 March 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

HRI06

Sponsor:

HRI06: International Conference on Human Robot Interaction

March 2 - 3, 2006

Utah, Salt Lake City, USA

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
559
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tabrez ALuebbers MHayes BPelachaud CTaylor MFaliszewski PMascardi V(2022)Descriptive and Prescriptive Visual Guidance to Improve Shared Situational Awareness in Human-Robot TeamingProceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems10.5555/3535850.3535990(1256-1264)Online publication date: 9-May-2022
https://dl.acm.org/doi/10.5555/3535850.3535990
Lee HCheon ELim CFischer K(2022)Configuring Humans: What Roles Humans Play in HRI Research2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889496(478-492)Online publication date: 7-Mar-2022
https://doi.org/10.1109/HRI53351.2022.9889496
Szafir DSzafir DBethel CPaiva ABroadbent EFeil-Seifer DSzafir D(2021)Connecting Human-Robot Interaction and Data VisualizationProceedings of the 2021 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3434073.3444683(281-292)Online publication date: 8-Mar-2021
https://dl.acm.org/doi/10.1145/3434073.3444683
Abtahi PSharma NLanday JFollmer S(2020)Presenting and Exploring Challenges in Human-Robot Interaction Design Through BodystormingDesign Thinking Research10.1007/978-3-030-62037-0_15(327-344)Online publication date: 29-Nov-2020
https://doi.org/10.1007/978-3-030-62037-0_15
Sauppé AMutlu BJones MPalanque PSchmidt AGrossman T(2014)Design patterns for exploring and prototyping human-robot interactionsProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2556288.2557057(1439-1448)Online publication date: 26-Apr-2014
https://dl.acm.org/doi/10.1145/2556288.2557057
Sarvadevabhatla RNg-Thow-Hing VOkita S(2010)Extended duration human-robot interaction: Tools and analysis19th International Symposium in Robot and Human Interactive Communication10.1109/ROMAN.2010.5598676(7-14)Online publication date: Sep-2010
https://doi.org/10.1109/ROMAN.2010.5598676
Sung JGrinter RChristensen HGuo LFong TDautenhahn KScheutz MDemiris Y(2008)Housewives or technophiles?Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction10.1145/1349822.1349840(129-136)Online publication date: 12-Mar-2008
https://dl.acm.org/doi/10.1145/1349822.1349840
Kooijmans TKanda TBartneck CIshiguro HHagita N(2007)Accelerating Robot Development Through Integral Analysis of Human–Robot InteractionIEEE Transactions on Robotics10.1109/TRO.2007.90626323:5(1001-1012)Online publication date: Oct-2007
https://doi.org/10.1109/TRO.2007.906263
Nabe SKanda THiraki KIshiguro HKogure KHagita NGoodrich MSchultz ABruemmer D(2006)Analysis of human behavior to a communication robot in an open fieldProceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction10.1145/1121241.1121282(234-241)Online publication date: 2-Mar-2006
https://dl.acm.org/doi/10.1145/1121241.1121282
Koay KZivkovic ZKrose BDautenhahn KWalters MOtero NAlissandrakis A(2006)Methodological Issues of Annotating Vision Sensor Data using Subjects' Own Judgement of Comfort in a Robot Human Following ExperimentROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication10.1109/ROMAN.2006.314396(66-73)Online publication date: Sep-2006
https://doi.org/10.1109/ROMAN.2006.314396
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten