skip to main content
10.1145/1121241.1121265acmconferencesArticle/Chapter ViewAbstractPublication PageshriConference Proceedingsconference-collections
Article

Evaluation of robot imitation attempts: comparison of the system's and the human's perspectives

Published: 02 March 2006 Publication History

Abstract

Imitation is a powerful learning tool when humans and robots interact in a social context. A series of experimental runs and a small pilot user study were conducted to evaluate the performance of a system designed for robot imitation. Performance assessments of similarity of imitative behaviours were carried out by machines and by humans: the system was evaluated quantitatively (from a machine-centric perspective) and qualitatively (from a human perspective) in order to study the reconciliation of these views. The experimental results presented here illustrate how the number of exceptions can be used as a performance measure by a robotic or software imitator of an object manipulation behaviour. (In this context, exceptions are events when the optimal displacement and/or rotation that minimize the dissimilarity metrics used to generate a corresponding imitative behaviour cannot be directly achieved in the particular context.) Results of the user study giving similarity judgments on imitative behaviours were used to examine how the quantitative measure of the number of exceptions (from a robot's perspective) corresponds to the qualitative evaluation of similarity (from a human's perspective) for the imitative behaviours generated by the jabberwocky system. Results suggest that there is a good alignment between this quantitive system centered assessment and the more qualitative human-centered assessment of imitative performance.

References

[1]
A. Alissandrakis, C. L. Nehaniv, K. Dautenhahn, and J. Saunders. Achieving corresponding effects on multiple robotic platforms: Imitating using different effect metrics. In Proc. Third International Symposium on Imitation in Animals and Artifacts -- Hatfield, UK, 12-14 April 2005, pages 10--19. Society for the Study of Artificial Intelligence and Simulation of Behaviour, 2005.
[2]
A. Alissandrakis, C. L. Nehaniv, K. Dautenhahn, and J. Saunders. An approach for programming robots by demonstration to manipulate objects: Considerations on metrics to achieve corresponding effects. In Proc. 6th IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA '05), pages 61--66, 2005.
[3]
A. Billard, Y. Epars, S. Calinon, G. Cheng, and S. Schaal. Discovering optimal imitation strategies. Robotics and Autonomous Systems, 47:2-3, 2004.
[4]
C. L. Breazeal, D. Buchsbaum, J. Gray, D. Gatenby, and B. Blumberg. Learning from and about others: Towards using imitation to bootstrap the social understanding of others by robots. Artificial Life, 11(1--2):31--62, 2005.
[5]
K. Dautenhahn. Getting to know each other -- artificial social intelligence for autonomous robots. Robotics and Autonomous Systems, 16:333--356, 1995.
[6]
Y. Demiris and M. Johnson. Distributed, predictive perception of actions: a biologically inspired robotics architecture for imitation and learning. Connection Science Journal, 15(4):231--243, 2003.
[7]
R. Dillmann. Teaching and learning of robot tasks via observation of human performance. Journal of Robotics & Autonomous Systems, 47(2--3):109--116, 2004.
[8]
Y. Kuniyoshi, M. Inaba, and H. Inoue. Learning by watching: Extracting reusable task knowledge from visual observations of human performance. IEEE Trans. Robot. Automat., 10:799--822, November 1994.
[9]
C. L. Nehaniv and K. Dautenhahn. Mapping between dissimilar bodies: Affordances and the algebraic foundations of imitation. In J. Demiris and A. Birk, editors, Proceedings European Workshop on Learning Robots 1998 (EWLR-7), Edinburgh, 20 July 1998, pages 64--72, 1998.
[10]
C. L. Nehaniv and K. Dautenhahn. Like me? - measures of correspondence and imitation. Cybernetics and Systems, 32(1-2):11--51, 2001.
[11]
M. N. Nicolescu and M. M. MatariĆ. Learning and interacting in human-robot domains. IEEE Transactions on Systems, Man, and Cybernetics, Part A, 31(5):419--430, 2001.
[12]
S. Schaal. Is imitation learning the route to humanoid robots? Trends in Cognitive Sciences, 3(6):233--242, 1999.

Cited By

View all
  • (2022)Configuring Humans: What Roles Humans Play in HRI Research2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889496(478-492)Online publication date: 7-Mar-2022
  • (2019)Online Vertex-Weighted Bipartite MatchingACM Transactions on Algorithms10.1145/332616915:3(1-15)Online publication date: 17-Jun-2019
  • (2019)A Lottery Model for Center-Type Problems With OutliersACM Transactions on Algorithms10.1145/331195315:3(1-25)Online publication date: 12-Jun-2019
  • Show More Cited By

Recommendations

Reviews

Goran Trajkovski

With the increasing evidence of the importance of learning via imitation in developmental psychology, studies of robot imitation are gaining momentum as a category of research in the interdisciplinary field of human-robot interaction (HRI). Following the research methodologies of the parent discipline of human-computer interaction (HCI), research labeled as HRI has already revitalized "traditional" (heavily artificial intelligence (AI)-based) robotics at a qualitatively new level. The hope now is that the merger of disciplines that HRI relies on will finally produce a man-made artifact that will truly be capable of imitating human behavior, a goal that AI failed to successfully reach. In this paper, the authors present a pilot study in robot imitation. The task is simple (object manipulation), and the study focuses on both quantitative and qualitative analysis of the experiments, respective to the machine-centric and user-centric evaluation. By playing with the effect metrics and introducing exceptions, the authors observe the imitation attempts of a Jabberwocky-based architecture, which, in principle, means that the system has a module on what to imitate and another on how to imitate a human action, and in an iterative fashion it learns how to successfully achieve the action it is attempting to mimic. This paper, as well as most of those included in the proceedings of the HRI 2006 conference, is interesting and informative. The story is told efficiently, and is well illustrated by figures and helpful captions. Online Computing Reviews Service

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
HRI '06: Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction
March 2006
376 pages
ISBN:1595932941
DOI:10.1145/1121241
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 March 2006

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. human-robot interaction
  2. imitation and social learning
  3. programming by demonstration

Qualifiers

  • Article

Conference

HRI06
HRI06: International Conference on Human Robot Interaction
March 2 - 3, 2006
Utah, Salt Lake City, USA

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Upcoming Conference

HRI '25
ACM/IEEE International Conference on Human-Robot Interaction
March 4 - 6, 2025
Melbourne , VIC , Australia

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)0
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Configuring Humans: What Roles Humans Play in HRI Research2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889496(478-492)Online publication date: 7-Mar-2022
  • (2019)Online Vertex-Weighted Bipartite MatchingACM Transactions on Algorithms10.1145/332616915:3(1-15)Online publication date: 17-Jun-2019
  • (2019)A Lottery Model for Center-Type Problems With OutliersACM Transactions on Algorithms10.1145/331195315:3(1-25)Online publication date: 12-Jun-2019
  • (2019)Simitate: A Hybrid Imitation Learning Benchmark2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS40897.2019.8968029(5243-5249)Online publication date: Nov-2019
  • (2019)Imitation of Human Motion by Low Degree-of-Freedom Simulated Robots and Human Preference for Mappings Driven by Spinal, Arm, and Leg ActivityInternational Journal of Social Robotics10.1007/s12369-019-00595-y11:5(765-782)Online publication date: 1-Oct-2019
  • (2018)Robot Learning from Demonstration in Robotic Assembly: A SurveyRobotics10.3390/robotics70200177:2(17)Online publication date: 16-Apr-2018
  • (2017)More than Meets the EyeJournal on Computing and Cultural Heritage 10.1145/305148010:2(1-15)Online publication date: 21-Mar-2017
  • (2017)Automatic Analysis of UV-Induced Fluorescence Imagery of Historical ViolinsJournal on Computing and Cultural Heritage 10.1145/305147210:2(1-13)Online publication date: 21-Mar-2017
  • (2017)From Reassembly to Object CompletionJournal on Computing and Cultural Heritage 10.1145/300990510:2(1-22)Online publication date: 21-Mar-2017
  • (2016)An Auction Mechanism for Cloud Spot MarketsACM Transactions on Autonomous and Adaptive Systems10.1145/284394511:1(1-33)Online publication date: 9-Feb-2016
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media