Tangicam: exploring observation tools for children

ABSTRACT

This paper describes the design and early evaluation of the Tangicam, or tangible camera, a mobile device for children to capture and edit realistic pictures and videos. Our first experimental results show that the affordances of the Tangicam allow imitation learning and free playing in a context of tangible and augmented reality. Our goal is to create a simple and robust observation system that lets children produce narratives based on situated [51] video, audio and sensor data. We also want to explore how these temporal structures may allow children to describe themselves, other children or natural phenomena and how such situated time series may help develop new forms of synaesthetic and intersubjective constructions.

REFERENCES

• 1: Ackermann, E. Piaget's constructivism, Papert's constructionism: What's the difference? In Future of learning group publication: 2001 http://learning.media.mit.edu/content/publications/EA.Piage%20 %2 0Papert.pdf
• 2: Robert Aish , James L. Frankel , John H. Frazer , Anthony T. Patera, Computational construction kits for geometric modeling and design (Panel Abstract), Proceedings of the 2001 symposium on Interactive 3D graphics, p.125-128, March 2001 [doi>10.1145/364338.364379]
• 3: David Anderson , James L. Frankel , Joe Marks , Darren Leigh , Eddie Sullivan , Jonathan Yedidia , Kathy Ryall, Building virtual structures with physical blocks, Proceedings of the 12th annual ACM symposium on User interface software and technology, p.71-72, November 07-10, 1999, Asheville, North Carolina, United States [doi>10.1145/320719.322587]
• 4: Michel Beaudouin-Lafon , Wendy E. Mackay, Reification, polymorphism and reuse: three principles for designing visual interfaces, Proceedings of the working conference on Advanced visual interfaces, p.102-109, May 2000, Palermo, Italy [doi>10.1145/345513.345267]
• 5: Beaudouin-Lafon, M., Druin, A., Eiderback, B., Harvard, A., Lindquist, S., Mackay, W. E., Plaisant, C., Sundblad, Y., Westerlund, B. InterLiving Deliverable 1.1, Technology Probes for Families. Technical report, CID/NADA, KTH, Sweden, oct. 2001, 100 pages. http://interliving.kth.se/papers.html
• 6: Begel, A. LogoBlocks: A Graphical Programming Language for Interacting with the World. Advanced Undergraduate Project. Massachusetts Institute of Technology. 1996. http://http.cs.berkeley.edu/~abegel/mit/begelaup.pdf
• 7: Marina U. Bers , Joseph Gonzalez-Heydrich , David Ray DeMaso, Identity construction environments: supporting a virtual therapeutic community of pediatric patients undergoing dialysis, Proceedings of the SIGCHI conference on Human factors in computing systems, p.380-387, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365302]
• 8: Jonathan Cohen , Meg Withgott , Philippe Piernot, Logjam: a tangible multi-person interface for video logging, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.128-135, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303013]
• 9: Cohn, J. F., Zlochower, A. J., Lien, J., Kanade, T. Automated face analysis by feature point tracking has high concurrent validity with manual FACS coding. Psychophysiology. 36, 35--43. 1999.
• 10: Dahiya, R. E-CUBes: Toys for active learning in early childhood. Master's thesis. Interaction Design Institute Ivrea, 2003 http://People.interaction-ivrea.it/r.dahiya/abstract.html
• 11: Françoise Decortis , Antonio Rizzo, New Active Tools for Supporting Narrative Structures, Personal and Ubiquitous Computing, v.6 n.5-6, p.416-429, December 2002 [doi>10.1007/s007790200046]
• 12: Where the action is: the foundations of embodied interaction, MIT Press, Cambridge, MA, 2001
• 13: David Frohlich , Ella Tallyn, Audiophotography: practice and prospects, CHI '99 extended abstracts on Human factors in computing systems, May 15-20, 1999, Pittsburgh, Pennsylvania [doi>10.1145/632716.632897]
• 14: William W. Gaver, Technology affordances, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.79-84, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108856]
• 15: Bill Gaver , Tony Dunne , Elena Pacenti, Design: Cultural probes, interactions, v.6 n.1, p.21-29, Jan./Feb. 1999 [doi>10.1145/291224.291235]
• 16: Judith Good , Judy Robertson, Computer games authored by children: a multi-perspective evaluation, Proceeding of the 2004 conference on Interaction design and children: building a community, p.123-124, June 01-03, 2004, Maryland [doi>10.1145/1017833.1017852]
• 17: Saul Greenberg , Chester Fitchett, Phidgets: easy development of physical interfaces through physical widgets, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502388]
• 18: Maria Hâkansson , Sara Ljungblad , Lars Erik Holmquist, Capturing the invisible: designing context-aware photography, Proceedings of the 2003 conference on Designing for user experiences, June 06-07, 2003, San Francisco, California [doi>10.1145/997078.997101]
• 19: Han, M., Kanade, T. Creating 3D Models with Uncalibrated Cameras. In Proc. IEEE Computer Society Workshop on the Application of Computer Vision (WACV2000). 2000.
• 20: Jennifer Healey , Rosalind W. Picard, StartleCam: A Cybernetic Wearable Camera, Proceedings of the 2nd IEEE International Symposium on Wearable Computers, p.42, October 19-20, 1998
• 21: Hourcade, J. P. It's too small ! Implications of children's developing motor skills on graphical user interfaces. Technical Report HCIL-2002-24, november 2002.
• 22: Huang, C-J., Yi-Luen Do, E., Gross, M. D. MouseHaus Table, a Physical Interface for Urban Design. In Proc. of the 16th Annual ACM Symposium on User Interface Software and Technology (UIST). 2003. http://dmg.caup.washington.edu/xmlSiteEngine/browsers/static/publication144.html
• 23: Ishii, H. Tangible Video Browser. T M G Publication. http://tangible.media.mit.edu/projects/Tangible Video Browser/Tangible Video Browser.htm
• 24: Sergi Jordà, Sonigraphical instruments: from FMOL to the reacTable, Proceedings of the 2003 conference on New interfaces for musical expression, May 22-24, 2003, Montreal, Quebec, Canada
• 25: Kafai, Y. B. Gender differences in children's constructions of video games. In Patricia M. Greenfield & Rodney R. Cocking (Eds.), Interacting with video (pp. 39--66). Norwood, NJ: Ablex Publishing Corporation. 1996.
• 26: Kay, A. C. A Personal Computer for Children of All Ages. In Proc. ACM National Conference, Boston Aug. 1972. http://www.mprove.de/diplom/aui/Kay72a.pdf
• 27: Kitamura, Y., Itoh, Y., Masaki, T., Kishino, F. ActiveCube: A Bi-directional User Interface using Cubes. KES 2000: Fourth International Conference on Knowledge-Based Intelligent Engineering Systems, pp. 99--102, 30 University of Brighton, UK. 2000
• 28: Levin, G. Painterly Interfaces for Audiovisual Performance. Master's thesis. Massachusetts Institute of Technology. September 2000. http://acg.media.mit.edu/people/golan/thesis/index.html
• 29: Andrea Lockerd , Florian Mueller Mueller, LAFCam: Leveraging affective feedback camcorder, CHI '02 extended abstracts on Human factors in computing systems, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/506443.506490]
• 30: W. E. Mackay, EVA: an experimental video annotator for symbolic analysis of video data, ACM SIGCHI Bulletin, v.21 n.2, p.68-71, Oct. 1989 [doi>10.1145/70609.70617]
• 31: W. E. Mackay , R. Guindon , M. M. Mantel , L. Suchman , D. G. Tatar, Video: Data for studying human-computer interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.133-137, May 15-19, 1988, Washington, D.C., United States [doi>10.1145/57167.57189]
• 32: Wendy E. Mackay , Glorianna Davenport, Virtual video editing in interactive multimedia applications, Communications of the ACM, v.32 n.7, p.802-810, July 1989 [doi>10.1145/65445.65447]
• 33: W. Mackay , D. Pagani, Video mosaic: laying out time in a physical space, Proceedings of the second ACM international conference on Multimedia, p.165-172, October 15-20, 1994, San Francisco, California, United States [doi>10.1145/192593.192646]
• 34: Heather Martin , Bill Gaver, Beyond the snapshot from speculation to prototypes in audiophotography, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, p.55-65, August 17-19, 2000, New York City, New York, United States [doi>10.1145/347642.347663]
• 35: Mazalek, A., Davenport, G., Ishii, H., "Tangible Viewpoints: A Physical Interface for Exploring Character-Driven Narratives" in Conference Abstracts and Applications of SIGGRAPH '02 (San Antonio, Texas, USA, July 21--26, 2002), ACM Press. 2002.
• 36: Messinger, D. S., Fogel, A., Dickson, K. L. What's in a smile? Developmental Psychology. 35, 701--708. 1999
• 37: Jaime Montemayor , Allison Druin , Allison Farber , Sante Simms , Wayne Churaman , Allison D'Amour, Physical programming: designing tools for children to create physical interactive environments, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503430]
• 38: Emmanuel Nars, A group communication infrastructure, Proceedings of the third Nordic conference on Human-computer interaction, p.429-432, October 23-27, 2004, Tampere, Finland [doi>10.1145/1028014.1028087]
• 39: Ron Oosterholt , Mieko Kusano , Govert de Vries, Interaction design and human factors support in the development of a personal communicator for children, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.450-457, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238603]
• 40: Paolantonio, S. Serendipity project. Master's thesis. Interaction Design Institute Ivrea. June 2003. http://people.interaction-ivrea.it/s.paolantonio/serendipity/home.htm
• 41: Seymour Papert, Mindstorms: Children, computers, and powerful ideas, Basic Books, Inc., New York, NY, 1980
• 42: James Patten , Hiroshi Ishii , Jim Hines , Gian Pangaro, Sensetable: a wireless object tracking platform for tangible user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.253-260, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365112]
• 43: James Patten , Ben Recht , Hiroshi Ishii, Audiopad: a tag-based interface for musical performance, Proceedings of the 2002 conference on New interfaces for musical expression, May 24-26, 2002, Dublin, Ireland
• 44: Piaget, J. & Inhelder, B. The Psychology of the Child. NY: Basic Books: 1969.
• 45: Y. Rogers , S. Price , G. Fitzpatrick , R. Fleck , E. Harris , H. Smith , C. Randell , H. Muller , C. O'Malley , D. Stanton , M. Thompson , M. Weal, Ambient wood: designing new forms of digital augmentation for learning outdoors, Proceeding of the 2004 conference on Interaction design and children: building a community, p.3-10, June 01-03, 2004, Maryland [doi>10.1145/1017833.1017834]
• 46: Sejer, O. and Nielsen, C. Using digital probes in design with children. In Proc. of IDC 2004, (June 1--3, 2004), College Park, Maryland, USA.
• 47: Chia Shen , Frédéric D. Vernier , Clifton Forlines , Meredith Ringel, DiamondSpin: an extensible toolkit for around-the-table interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.167-174, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985714]
• 48: Smith, B. The Ecological Approach to Information Processing. Report for the Alexander von Humboldt Foundation. 2003 http://ontology.buffalo.edu/smith/articles/EcologicalApproach.pdf
• 49: Sony Vaio GT. PCG-GT3K http://sony.co.jp/sd/ProductsPark/Consumer/PCOM/PCG-GT3K/
• 50: Strohecker, C. & M. Ananny (2003). Constructing Intermodal Literacies. Proc. of Technology Enhanced Learning. Milan, Italy. November 20--21. 2003.
• 51: Lucy A. Suchman, Plans and situated actions: the problem of human-machine communication, Cambridge University Press, New York, NY, 1987
• 52: Suzuki, H., & Kato, H. (1993). Algoblock: A tangible programming language, a tool for collaborative learning. In Proceedings of the Fourth European Logo Conference (p. 297--303). 1993
• 53: Vallacher, R. R, Wegner, D. M. What do people think they are doing? Action identification and human behavior. Psychological Review. 94, 3--15. 1987
• 54: Wellner, P., Mackay, W. E. and Gold, R., Editors (July 1993). Special Issue on Computer-Augmented Environments, Communications of the ACM. New York: ACM. 1993
• 55: Danielle Wilde , Eric Harris , Yvonne Rogers , Cliff Randell, The Periscope: supporting a computer enhanced field trip for children, Personal and Ubiquitous Computing, v.7 n.3-4, p.227-233, July 2003 [doi>10.1007/s00779-003-0230-2]
• 56: Wyeth P., Wyeth, G. F. Electronic Blocks: Tangible Programming Elements for Preschoolers. In Proc. of Eighth IFIP TC.13 Conference On Human-Computer Interaction (INTERACT 2001), July 9--13, Tokyo, pp. 496 -- 503. 2001
• 57: Zuckerman, O., Resnick, M. System Blocks: A Physical Interface for System Dynamics Learning. In Proc. 21st International System Dynamics Conference. 2003

INDEX TERMS

Keywords:
augmented reality, free play, inter-subjectivity, mixed reality, physical video editing, self-observation, sensors, synaesthesia