skip to main content
10.1145/1514095.1514166acmconferencesArticle/Chapter ViewAbstractPublication PageshriConference Proceedingsconference-collections
abstract

Evaluating the ICRA 2008 HRI challenge

Published: 09 March 2009 Publication History

Abstract

This paper reports on the evaluation of the ICRA 2008 Human-Robot Interaction (HRI) Challenge. Five research groups demonstrated state-of-the-art work on HRI with a special focus on social and learning abilities. The demonstrations were rated by expert evaluators, in charge of awarding the prize, and 269 participants, i.e. 20 percent of the conference attendees through a standardized questionnaire (semantic differential). The data was analyzed with respect to six independent variables: expert evaluators vs. attendees, nationality of participants, origin region of the demo, age, gender and knowledge level of the attendees. Conference attendees tended to give higher scores for Social Skills, General Impression, and Overall Score than the expert evaluators. Irrespectively of the level of knowledge, age, and gender, conference attendees rated all demos relatively homogeneously. However, a comparative analysis of the conference attendees's ratings nationality-wise showed that demonstrations were rated differently depending on the region of origin. Conference attendees for the USA and Asian countries tended to rate demos from the same country of origin more frequently and more positively.

References

[1]
IEEE robotics & automation magazine - finding the right path. Robotics & Automation Magazine, IEEE, 15(3):10--15, September 2008.
[2]
S. Calinon and A. Billard. Active teaching in robot programming by demonstration. In Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pages 702--707, August 2007.
[3]
C. Kidd and C. Breazeal. Designing a sociable robot system for weight maintenance. Consumer Communications and Networking Conference, 2006.
[4]
CCNC 2006. 3rd IEEE, 1:253--257, Jan. 2006.
[5]
H. Kozima, Y. Yasuda, and C. Nakagawa. Social interaction facilitated by a minimally-designed robot: Findings from longitudinal therapeutic practices for autistic children. In Robot and Human interactive Communication, 2007. RO-MAN 2007. The 16th IEEE International Symposium on, pages 599--604, Aug. 2007.
[6]
N. Mitsunaga, T. Miyashita, H. Ishiguro, K. Kogure, and N. Hagita. Robovie-iv: A communication robot interacting with people daily in an office. In Intelligent Robots and Systems, 2006 IEEE/RSJ International Conference on, pages 5066--5072, Oct. 2006.
[7]
S. Woods, M. Walters, K. Koay, and K. Dautenhahn. Comparing human robot interaction scenarios using live and video based methods: towards a novel methodological approach. In Advanced Motion Control, 2006. 9th IEEE International Workshop on, pages 750--755, 2006.

Cited By

View all
  • (2022)A Methodology to Design and Evaluate HRI Teaming Tasks in Robotic CompetitionsACM Transactions on Human-Robot Interaction10.1145/352841511:3(1-22)Online publication date: 2-Sep-2022
  • (2012)Model for controlling a target human's attention in multi-party settings2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication10.1109/ROMAN.2012.6343797(476-483)Online publication date: Sep-2012
  • (2011)Nonverbal robot-group interaction using an imitated gaze cueProceedings of the 6th international conference on Human-robot interaction10.1145/1957656.1957824(497-504)Online publication date: 6-Mar-2011

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
HRI '09: Proceedings of the 4th ACM/IEEE international conference on Human robot interaction
March 2009
348 pages
ISBN:9781605584041
DOI:10.1145/1514095

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 March 2009

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. evaluation
  2. expert evaluation
  3. human-robot interaction challenge
  4. user-based evaluation

Qualifiers

  • Abstract

Conference

HRI09
HRI09: International Conference on Human Robot Interaction
March 9 - 13, 2009
California, La Jolla, USA

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Upcoming Conference

HRI '25
ACM/IEEE International Conference on Human-Robot Interaction
March 4 - 6, 2025
Melbourne , VIC , Australia

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)A Methodology to Design and Evaluate HRI Teaming Tasks in Robotic CompetitionsACM Transactions on Human-Robot Interaction10.1145/352841511:3(1-22)Online publication date: 2-Sep-2022
  • (2012)Model for controlling a target human's attention in multi-party settings2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication10.1109/ROMAN.2012.6343797(476-483)Online publication date: Sep-2012
  • (2011)Nonverbal robot-group interaction using an imitated gaze cueProceedings of the 6th international conference on Human-robot interaction10.1145/1957656.1957824(497-504)Online publication date: 6-Mar-2011

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media