Article

Using context and sensory data to learn first and second person pronouns

Authors:

Brian ScassellatiAuthors Info & Claims

HRI '06: Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction

Pages 110 - 117

https://doi.org/10.1145/1121241.1121262

Published: 02 March 2006 Publication History

Abstract

We present a method of grounded word learning that can learn the meanings of first and second person pronouns. The model selectively associates new words with agents in the environment by using already understood words to establish context. The method uses chi-square tests to find significant associations between the new words and attributes of the relevant agents. We show that this model can learn from a transcript of a parent-child interaction that "I" refers to the person who is speaking. With the additional information that questions about wants refer to the person being asked about them, the system learns that "you" refers to the person being addressed. We show that an incorrect assumption about the subject of "want" questions can lead to pronoun reversal, a linguistic error most commonly found in autistic and congenitally blind children. Finally, we present results from a physical implementation on a robot that runs in real time.

References

[1]

D. K. Roy and A. P. Pentland, "Learning words from sights and sounds: a computational model," Cognitive Science, vol. 26, pp. 113--146, 2002.

[2]

P. S. Dale and C. Crain-Thoreson, "Pronoun reversals: who, when, and why," Journal of Child Language, vol.20, pp. 573--579, 1993.

[3]

E. V. Clark, "From gesture to word: on the natural history of deixis in language acquisition," in Human growth and development: Wolfram College lectures 1976, J. S. Bruner and A. Garton, Eds. Oxford: Oxford UP, 1978.

[4]

C. Lord and R. Paul, "Language and communication in autism," in Handbook of Autism and Pervasive Development Disorders, 2nd ed., D. J. Cohen and F.R. Volkmar, Eds. New York: Wiley, 1997, pp. 195--225.

[5]

S. Fraiberg and E. Adelson, "Self-representation in language and play," in Insights from the blind, S. Fraiberg, Ed. New York: Basic Books, 1977.

[6]

E. S. Andersen, A. Dunlea, and L. S. Kekelis, "Blind children's language: resolving some differences," Journal of Child Language, vol. 11, pp. 645--664, 1984.

[7]

R. Brown, R. P. Hobson, A. Lee, and J. Stevenson, "Are there 'autistic-like' features in congenitally blind children?" Journal of Child Psychology and Psychiatry, vol. 38, pp. 693--703, 1997.

[8]

M. Pérez-Pereira, "Deixis, personal reference, and the use of pronouns by blind children," Journal of Child Language, vol. 26, pp. 655--680, 1999.

[9]

Y. Oshima-Takane, "Analysis of pronominal errors: a case study," Journal of Child Language, vol. 19, 1992.

[10]

Y. Oshima-Takane, E. Goodz, and J. L. Derevensky, "Birth order effects on early language development: do secondborn children learn from overheard speech?" Child Development, vol. 67, pp. 621--634, 1996.

[11]

Y. Oshima-Takane, "Children learn from speech not addressed to them: the case of personal pronouns," Journal of Child Language, vol. 15, pp. 95--108, 1988.

[12]

Y. Oshima-Takane, Y. Takane, and T. Shultz, "The learning of first and second person pronouns in English: network models and analysis," Journal of Child Language, vol. 26, pp. 545--575, 1999.

[13]

S. R. H. Langton, R. J. Watt, and V. Bruce, "Do the eyes have it? Cues to the direction of social attention," Trends in Cognitive Sciences, vol. 4, no. 2, 2000.

[14]

J. A. Anderson, An Introduction to Neural Networks. Cambridge, MA: MIT Press, 1995.

[15]

G. Boole, "The laws of thought," in George Boole's Collected Logical Works, Vol. 2. La Salle, Illinois: The Open Court Publishing Company, 1854/1952.

[16]

L. G. Valiant, Circuits of the Mind. New York: Oxford UP, 1994.

Digital Library

[17]

C. D. Manning and H. Schütze, Foundations of Statistical Natural Language Processing. Cambridge, MA: MIT Press, 1999.

Digital Library

[18]

J. N. B. III, "Transcript /eng-usa/bohannon/bax/leah1.cha," 1976.

[19]

J. N. B. III and A. L. Marquis, "Children's control of adult speech," Child Development, vol. 48, pp. 1002--1008, 1977.

[20]

E. L. Stine and J. N. B. III, "Imitations, interactions, and language acquisition," Journal of Child Language, vol. 10, pp. 589--603, 1983.

[21]

B. MacWhinney, The CHILDES project: Tools for analyzing talk, 3rd ed. Mahwah, NJ: Lawrence Erlbaum Associates, 2000.

[22]

S. Baron-Cohen, Mindblindness. Cambridge, MA: MIT Press, 1995.

[23]

G. Bradski, A. Kaehler, and V. Pisarevsky, "Learning-based computer vision with Intel's open source computer vision library," Intel Technology Journal, vol. 9, no. 1, 2005, available online.

[24]

W. Walker, P. Lamere, P. Kwok, B. Raj, R. Singh, E. Gouvea, P. Wolf, and J. Woelfel, "Sphinx-4: A flexible open source framework for speech recognition," Sun Microsystems, Tech. Rep. TR-2004-139, Nov 2004.

Digital Library

[25]

P. Bloom, How Children Learn the Meanings of Words. Cambridge, Massachusetts: MIT Press, 2000.

[26]

C. G. de Marcken, "Unsupervised language acquisition," Ph.D. dissertation, MIT, 1996.

Digital Library

[27]

M. R. Brent and T. A. Cartwright, "Distributional regularity and phonotactic constraints are useful for segmentation," Cognition, vol. 61, pp. 93--125, 1996.

[28]

T. Gambell and C. Yang, "Mechanisms and contstraints in word segmentation," On the web at http://pantheon.yale.edu/~cdy4/, Submitted.

[29]

K. Gold and B. Scassellati, "Learning acceptable windows of contingency," Connection Science, to appear.

Cited By

Lee HCheon ELim CFischer K(2022)Configuring Humans: What Roles Humans Play in HRI Research2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889496(478-492)Online publication date: 7-Mar-2022
https://doi.org/10.1109/HRI53351.2022.9889496
Pointeau GPetit MGibert GDominey P(2014)Emergence of the use of pronouns and names in triadic human-robot spoken interaction4th International Conference on Development and Learning and on Epigenetic Robotics10.1109/DEVLRN.2014.6982970(146-152)Online publication date: Oct-2014
https://doi.org/10.1109/DEVLRN.2014.6982970
Guo CYoung JSharlin EOlsen DArthur RHinckley KMorris MHudson SGreenberg S(2009)Touch and toysProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/1518701.1518780(491-500)Online publication date: 4-Apr-2009
https://dl.acm.org/doi/10.1145/1518701.1518780
Show More Cited By

Index Terms

Using context and sensory data to learn first and second person pronouns

Recommendations

Robotic vocabulary building using extension inference and implicit contrast

TWIG (''Transportable Word Intension Generator'') is a system that allows a robot to learn compositional meanings for new words that are grounded in its sensory capabilities. The system is novel in its use of logical semantics to infer which entities in ...
Unification of demonstrative pronouns in a small group guided by a robot
HAI '14: Proceedings of the second international conference on Human-agent interaction

For realizing smooth communication, participants' viewpoints and usages of demonstrative pronouns assume an important role. Moreover, they both are strongly associated and construct a dialogue structure among participants. In this study, we investigate ...
Korean null pronouns: classification and annotation
DiscAnnotation '04: Proceedings of the 2004 ACL Workshop on Discourse Annotation

This paper discusses an annotation scheme for Korean null pronouns, which were used in annotating three kinds of Korean text corpora including Penn Korean Treebank. In annotating the corpora, null pronouns and their antecedents were marked up for their ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '06: Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction

March 2006

376 pages

ISBN:1595932941

DOI:10.1145/1121241

General Chair:
Michael A. Goodrich
Brigham Young University USA
,
Program Chairs:
Alan C. Schultz
Naval Research Laboratory, USA
,
David J. Bruemmer
Idaho National Laboratory, USA

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 March 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

HRI06

Sponsor:

HRI06: International Conference on Human Robot Interaction

March 2 - 3, 2006

Utah, Salt Lake City, USA

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
332
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)3

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lee HCheon ELim CFischer K(2022)Configuring Humans: What Roles Humans Play in HRI Research2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889496(478-492)Online publication date: 7-Mar-2022
https://doi.org/10.1109/HRI53351.2022.9889496
Pointeau GPetit MGibert GDominey P(2014)Emergence of the use of pronouns and names in triadic human-robot spoken interaction4th International Conference on Development and Learning and on Epigenetic Robotics10.1109/DEVLRN.2014.6982970(146-152)Online publication date: Oct-2014
https://doi.org/10.1109/DEVLRN.2014.6982970
Guo CYoung JSharlin EOlsen DArthur RHinckley KMorris MHudson SGreenberg S(2009)Touch and toysProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/1518701.1518780(491-500)Online publication date: 4-Apr-2009
https://dl.acm.org/doi/10.1145/1518701.1518780
Steinfeld AJenkins OScassellati BScheutz MMichaud FHinds PScassellati B(2009)The oz of wizardProceedings of the 4th ACM/IEEE international conference on Human robot interaction10.1145/1514095.1514115(101-108)Online publication date: 9-Mar-2009
https://dl.acm.org/doi/10.1145/1514095.1514115
Scassellati BCrick CGold KKim EShic FSun G(2006)Social development [robots]IEEE Computational Intelligence Magazine10.1109/MCI.2006.16729871:3(41-47)Online publication date: 1-Aug-2006
https://dl.acm.org/doi/10.1109/MCI.2006.1672987

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten