Evaluation of robot imitation attempts: comparison of the system's and the human's perspectives

ABSTRACT

Imitation is a powerful learning tool when humans and robots interact in a social context. A series of experimental runs and a small pilot user study were conducted to evaluate the performance of a system designed for robot imitation. Performance assessments of similarity of imitative behaviours were carried out by machines and by humans: the system was evaluated quantitatively (from a machine-centric perspective) and qualitatively (from a human perspective) in order to study the reconciliation of these views. The experimental results presented here illustrate how the number of exceptions can be used as a performance measure by a robotic or software imitator of an object manipulation behaviour. (In this context, exceptions are events when the optimal displacement and/or rotation that minimize the dissimilarity metrics used to generate a corresponding imitative behaviour cannot be directly achieved in the particular context.) Results of the user study giving similarity judgments on imitative behaviours were used to examine how the quantitative measure of the number of exceptions (from a robot's perspective) corresponds to the qualitative evaluation of similarity (from a human's perspective) for the imitative behaviours generated by the jabberwocky system. Results suggest that there is a good alignment between this quantitive system centered assessment and the more qualitative human-centered assessment of imitative performance.

REFERENCES

• 1: A. Alissandrakis, C. L. Nehaniv, K. Dautenhahn, and J. Saunders. Achieving corresponding effects on multiple robotic platforms: Imitating using different effect metrics. In Proc. Third International Symposium on Imitation in Animals and Artifacts -- Hatfield, UK, 12-14 April 2005, pages 10--19. Society for the Study of Artificial Intelligence and Simulation of Behaviour, 2005.
• 2: A. Alissandrakis, C. L. Nehaniv, K. Dautenhahn, and J. Saunders. An approach for programming robots by demonstration to manipulate objects: Considerations on metrics to achieve corresponding effects. In Proc. 6th IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA '05), pages 61--66, 2005.
• 3: A. Billard, Y. Epars, S. Calinon, G. Cheng, and S. Schaal. Discovering optimal imitation strategies. Robotics and Autonomous Systems, 47:2-3, 2004.
• 4: Cynthia Breazeal , Daphna Buchsbaum , Jesse Gray , David Gatenby , Bruce Blumberg, Learning From and About Others: Towards Using Imitation to Bootstrap the Social Understanding of Others by Robots, Artificial Life, v.11 n.1, p.31-62, January 2005 [doi>10.1162/1064546053278955]
• 5: K. Dautenhahn. Getting to know each other -- artificial social intelligence for autonomous robots. Robotics and Autonomous Systems, 16:333--356, 1995.
• 6: Y. Demiris and M. Johnson. Distributed, predictive perception of actions: a biologically inspired robotics architecture for imitation and learning. Connection Science Journal, 15(4):231--243, 2003.
• 7: R. Dillmann. Teaching and learning of robot tasks via observation of human performance. Journal of Robotics & Autonomous Systems, 47(2--3):109--116, 2004.
• 8: Y. Kuniyoshi, M. Inaba, and H. Inoue. Learning by watching: Extracting reusable task knowledge from visual observations of human performance. IEEE Trans. Robot. Automat., 10:799--822, November 1994.
• 9: C. L. Nehaniv and K. Dautenhahn. Mapping between dissimilar bodies: Affordances and the algebraic foundations of imitation. In J. Demiris and A. Birk, editors, Proceedings European Workshop on Learning Robots 1998 (EWLR-7), Edinburgh, 20 July 1998, pages 64--72, 1998.
• 10: C. L. Nehaniv and K. Dautenhahn. Like me? - measures of correspondence and imitation. Cybernetics and Systems, 32(1-2):11--51, 2001.
• 11: M. N. Nicolescu and M. M. MatariĆ. Learning and interacting in human-robot domains. IEEE Transactions on Systems, Man, and Cybernetics, Part A, 31(5):419--430, 2001.
• 12: S. Schaal. Is imitation learning the route to humanoid robots? Trends in Cognitive Sciences, 3(6):233--242, 1999.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.9 Robotics

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.6 Learning
      I.2.m Miscellaneous

Keywords:
human-robot interaction, imitation and social learning, programming by demonstration