skip to main content
10.1145/1322192.1322226acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
poster

A large-scale behavior corpus including multi-angle video data for observing infants' long-term developmental processes

Published: 12 November 2007 Publication History

Abstract

We have developed a method for multimodal observation of infant development. In order to analyze development of problem solving skills by observing scenes of task achievement or communication with others, we have introduced a method for extracting detailed behavioral features expressed by gestures or eyes. We have realized an environment for recording behavior of the same infants continuously as multi-angle video. The environment has evolved into a practical infrastructure through the following four steps; (1) Establish an infant school and study the camera arrangement. (2) Obtain participants in the school who agree with the project purpose and start to hold regular classes. (3) Begin to construct a multimodal infant behavior corpus with considering observation methods. (4) Practice development process analyses using the corpus. We have constructed a support tool for observing a huge amount of video data which increases with age. The system has contributed to enrich the corpus with annotations from multimodal viewpoints about infant development. With a focus on the demonstrative expression as a fundamental human behavior, we have extracted 240 scenes from the video during 10 months and observed them. The analysis results have revealed interesting findings about the developmental changes in infants' gestures and eyes, and indicated the effectiveness of the proposed observation method.

References

[1]
Saki Kawaguchi, Shinichi Sakane, Yutaka Sakane, Yoichi Takebayashi: A Consideration of Infant Education for Enhancing Communications Among Parents and Children, The 67th IPSJ, 5A-2 (2005).
[2]
Heikki RUUSKA, Naofumi OTANI, Shinya KIRIYAMA and Yoichi TAKEBAYASHI: Creating Reflective Reasoning Models Based on Observations of Social Problem-Solving in Infants, The 17th European-Japanese Conference on Information Modelling and Knowledge Bases (2007.6).
[3]
DK, O.: Metaphonology and infant vocalizations, In precursors of Early Speech, pp. 21--35 (1986).
[4]
Ejiri, K.: Relationship between rhythmic behavior and canonical babbling in infant development, Phonetica, Vol.54, pp. 226--237 (1998).
[5]
Hsu, H., Fogel, A. and Cooper, R.B: Infant Vocal Development during the First 6 Months: Speech Quality and Melodic Complexity, Infant and Child Development, Vol.9, No.1, pp. 1--16 (2000).
[6]
Pizer, G.: Baby Singing as Language Socialization: The Use of Visual-Gestural Signs with Hearing Infants, Proc. of the 11th Annual Symposium about Language and Society, Vol.47, pp. 165--171 (2004).
[7]
Petters, D.: Building agents to understand infant attachment behaviour, International Joint Conference on Artificial Intelligence 2005, pp.158--165 (2005).
[8]
Toward an ecological description of actions. . - How does body movement specify the environment? - http://www.rdc.imi.i.utokyo.ac.jp/robotbrain/e/results/pdf/sasaki.pdf
[9]
Roy, D., Patel, R., DeCamp, P., Kubat, R., Fleischman, M., Roy, B., Mavridis, N., Tellex, S., Salata, A., Guiness, J., Levit, M. and Gorniak, P.: The Human Speechome Project, the Proceedings of the Twenty-eighth Annual Meeting of the Cognitive Science Society (2006).
[10]
Daiichiro Kato, Tetsuo Katsuura and Hideo Koyama: Automatic Control of a Robot Camera for Broadcasting Based on Cameramens Techniques and Subjective Evaluation and Analysis of Reproduced Images, Journal of PHYSIOLOGICAL ANTHROPOLOGY and Applied Human Science, 19(2), pp.61--71 (2000).
[11]
Satoshi Nishiguchi, Yoshinari Kameda, Koh Kakusho and Michihiko Minoh: Automatic video recording of lecture considering variety of motion and equability of scale for observing students, Journal of Advanced Computational Intelligence and Intelligent Informatics, Vol.8 No.2 pp.180--188 (2004).
[12]
Jin Ryong Kim, Youjip Won, Yuichi Iwadate: Adaptive QoS Framework for Multiview 3D Streaming, International Conference on Computational Science, pp.519--522 (2004).
[13]
Singh, P.: EM-ONE: An Architecture for Reflective Commonsense Thinking, PhD Thesis, Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology (2005).
[14]
Morgan, B.: Roboverse: Physical Robot Simulation, http://neuralmom.media.mit.edu/¿neptune/roboverse.html. 192.

Cited By

View all
  • (2014)Multimodal bodily feeling analysis to design air conditioning services for elderly peopleProceedings of the second international conference on Human-agent interaction10.1145/2658861.2658907(141-144)Online publication date: 29-Oct-2014
  • (2010)A study of constructing a thinking process model based on multimodal behavior analysisProceedings of the 1st international workshop on Semantic models for adaptive interactive systems10.1145/2002375.2002377(6-10)Online publication date: 7-Feb-2010
  • (2009)Child selection of learning methodsProceedings of the 2nd Workshop on Child, Computer and Interaction10.1145/1640377.1640393(1-4)Online publication date: 5-Nov-2009

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ICMI '07: Proceedings of the 9th international conference on Multimodal interfaces
November 2007
402 pages
ISBN:9781595938176
DOI:10.1145/1322192
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 November 2007

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. behavior observation
  2. infant development
  3. multi-angle video
  4. multimodal behavior corpus

Qualifiers

  • Poster

Conference

ICMI07
Sponsor:
ICMI07: International Conference on Multimodal Interface
November 12 - 15, 2007
Aichi, Nagoya, Japan

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 30 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2014)Multimodal bodily feeling analysis to design air conditioning services for elderly peopleProceedings of the second international conference on Human-agent interaction10.1145/2658861.2658907(141-144)Online publication date: 29-Oct-2014
  • (2010)A study of constructing a thinking process model based on multimodal behavior analysisProceedings of the 1st international workshop on Semantic models for adaptive interactive systems10.1145/2002375.2002377(6-10)Online publication date: 7-Feb-2010
  • (2009)Child selection of learning methodsProceedings of the 2nd Workshop on Child, Computer and Interaction10.1145/1640377.1640393(1-4)Online publication date: 5-Nov-2009

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media