Scott S. Snibbe
ABSTRACT
Based on ten years' experience developing interactive camera/projector systems for public science and culture exhibits, we define a distinct form of augmented reality focused on social interaction: social immersive media. Our work abandons GUI metaphors and builds on the language of cinema, casting users as actors within simulated narrative models. We articulate philosophical goals, design principles, and interaction techniques that create strong emotional responses and social engagement through visceral interaction. We describe approaches to clearly communicate cultural and scientific ideas through the medium. And we demonstrate how practitioners can design interactions that promote specific social behaviors in users.
Supplemental Material
- Alexander, C., A Pattern Language. New York, Oxford University Press, 1977.Google Scholar
- Argyle, M. Bodily Communication. International Universities Press, 1977.Google Scholar
- Bowser, E. The Transformation of Cinema, 1907-1915, University of California Press, 1994.Google Scholar
- Brave, S. and Dahley, A., inTouch: A Medium for Haptic Interpersonal Communication. Ext. Abstracts CHI '97, ACM Press, 363--364. Google ScholarDigital Library
- Bregler, C. et al., Squidball: An Experiment in Large-Scale Motion Capture and Game Design. Intelligent Technologies for Interactive Entertainment, 2005, 23--33. Google ScholarDigital Library
- Bruner, J. Towards a Theory of Instruction. Belknap Press: 1966.Google Scholar
- Buxton, W., Multi-Touch Systems that I Have Known and Loved. Microsoft Research, 2007.Google Scholar
- Buxton, W., Fitzmaurice, G., Balakrishnan, R., Kurtenbach, G. Large displays in automotive design. IEEE Computer Graphics&Applications, July 2000. Google ScholarDigital Library
- Carpenter, L., Video Imaging Method and Apparatus for Audience Participation, US Patent 5,365,266, 1994.Google Scholar
- Chang, B. and Ungar, D., Animation: from cartoons to the user interface. Proc. UIST, 1993. Google ScholarDigital Library
- Crafton, D., Before Mickey: The Animated Film, 1898-1928, University of Chicago Press, 1993.Google Scholar
- Crowley, K. et al., Designing for Science: Implications From Everyday, Classroom, and Professional Settings. Lawrence Erlbaum Associates, Inc., 2001.Google Scholar
- Darrell, T. et al., Magic Morphin' Mirror: Person Detection and Tracking. Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1998, p. 964. Google ScholarDigital Library
- Eames, C. and Eames, R. Powers of Ten, 1977. http://www.powersof10.comGoogle Scholar
- EyeToy. Sony Corporation. http://www.eyetoy.comGoogle Scholar
- Feiner, S. K., Augmented Reality: A New Way of Seeing: Computer scientists are developing systems that can enhance and enrich a user's view of the world. Scientific American, April, 2002.Google Scholar
- Freeman, W. T. et al, Computer Vision for Interactive Computer Graphics, IEEE Computer Graphics and Applications, Vol. 18, No. 3, May-June 1998. Google ScholarDigital Library
- Frei, P. et al., Curlybot: designing a new class of computational toys. Proc. CHI 2000, 129--136. Google ScholarDigital Library
- GestureTek. http://www.gesturetek.comGoogle Scholar
- Hämäläinen, P., Ilmonen, T., Höysniemi, J, Lindholm, M., Nykänen, A. Martial Arts in Artificial Reality. Proc. CHI 2005. Google ScholarDigital Library
- Herndon, K., Zeleznik, R., Robbins, D., Conner, D., Snibbe, S., Van Dam, A. Interactive shadows, Proc. UIST 1992, 1--6. Google ScholarDigital Library
- Hutchins, E. L., Hollan, J. D., and Norman, D. A. Direct Manipulation Interfaces. In Human-Computer interaction: A Multidisciplinary Approach, R. M. Baecker, Ed. Morgan Kaufmann Publishers, San Francisco, CA, 468--470. 1987. Google ScholarDigital Library
- Ishii, H. et al., ambientROOM: integrating ambient media with architectural space. Proc. CHI '98, 173--174. Google ScholarDigital Library
- Thomas, F. and Johnson, O. Disney Animation: The Illusion of Life, Abbeville Press, 1981.Google Scholar
- Klein, Norman M., The Electronic Baroque: Jerde Cities. in You Are Here: The Jerde Partnership International, ed. Frances Anderton. London, Phaidon Press Limited, 1999, 112--121.Google Scholar
- Krueger, M., Gionfriddo, T. and Hinrichen, K. Videoplace - An Artificial Reality. Proc. CHI 1985. Google ScholarDigital Library
- Krueger, M., Environmental Technology Making the Real World Virtual. Communications of the ACM, 36,7 (July 1993), 36--37. Google ScholarDigital Library
- Larssen, A.T. et al., Understanding Movement as Input for Interaction. A Study of Two Eyetoy Games. Proc. CHI, 2004.Google Scholar
- Laurel, B. Computers as Theatre. Addison-Wesley Pub. Comp. Reading, Massachusetts, 1991. Google ScholarDigital Library
- Levin, G. and Lieberman, Z. Sounds from Shapes: Audiovisual Performance with Hand Silhouette Contours in The Manual Input Sessions. Proc. NIME 2005. Google ScholarDigital Library
- Maes, P. et al, The ALIVE System: Wireless, Full-Body Interaction with Autonomous Agents, ACM Multimedia Systems, 1996. Google ScholarDigital Library
- Maynes-Aminzade, D., Pausch, R. and Seitz, S. Techniques for Interactive Audience Participation. Proc. ICMI 2002. Google ScholarDigital Library
- Merleau-Ponty, M. Phenomenology of Perception (Transl. Colin Smith). Routledge, 2002.Google Scholar
- Mori, Masahiro. Bukimi no tani / The uncanny valley (MacDorman, K. F.&Minato, T. Trans.). Energy, 7(4), 33--35, 1970Google Scholar
- Minomo, Y., Kakehi, Y., Lida, M. Transforming Your Shadow into Colorful Visual Media - Multi-Projection of Complementary Colors. Proccedings of Advances in Computer Entertainment (ACE) 2006. ACM Press. Google ScholarDigital Library
- Mueller, F., Agamanolis, S., Picard, R. Exertion Interfaces: sports over a distance for social bonding and fun, Proc. CHI 2003. Google ScholarDigital Library
- Nintendo Wii. http://www.nintendo.com/wiiGoogle Scholar
- Parker, J.R., Games for physical activity: A Preliminary Examination of the Nintendo Wii. Sixth International Symposium on Computer Science in Sport, 2007.Google Scholar
- Piaget, J. The Grasp of Consciousness. Cambridge: Harvard University Press, 1976.Google Scholar
- Raffle, H., Parkes, A., and Ishii, H. Topobo: a constructive assembly system with kinetic memory. Proc. CHI 2004, 647--654. Google ScholarDigital Library
- Reactrix. http://www.reactrix.comGoogle Scholar
- Reeves, S. Research techniques for augmented reality. Technical Report, University of Nottingham, 2004.Google Scholar
- Rockwell, T. San Francisco Exploratorium. Videotaped interview. http://www.snibbeinteractive.com, 2005.Google Scholar
- Rokeyby, D. Transforming Mirrors: Subjectivity and Control in Interactive Media. In Critical Issues in Interactive Media. Simon Penny, SUNY press, 1996.Google Scholar
- Rozin, D. http://en.wikipedia.org/wiki/Daniel_Rozin and http://www.smoothware.com/danny/Google Scholar
- Schenck et al, Cyberarts 98: International Compendium Prix Ars Electronica. Ars Electronica, 1998.Google Scholar
- Science Museum of Minnesota, Comparative Report Formative Evaluation Exhibit Package Prototypes. May, 2007.Google Scholar
- Simpson, Z. Shadow Garden. SIGGRAPH 2002 Electronic Art and Animation Catalog.Google Scholar
- Sitney, P., Visionary Film, 2d edition, New York, 1979.Google Scholar
- Shoemaker, G., Tang, A., and Booth, K., Shadow Reaching: A New Perspective on Interaction for Large Wall Displays. Proc. UIST 2007. Google ScholarDigital Library
- Snibbe, S. Body, Screen and Shadow. San Francisco Media Arts Council (SMAC) Journal, 2003. http://snibbe.com/scott/SMAC/smac_jan03.html.Google Scholar
- Snibbe, S. Three Drops. ArtNano: New Approaches for Visualizing the Nanoscale, 2006. http://www.nisenet.org/artnano/artists/snibbe/artwork/.Google Scholar
- Snibbe, S. and Levin, G. Interactive Dynamic Abstraction, Proc. NPAR 2000, Annecy, France: ACM, 21--29. Google ScholarDigital Library
- Strothotte, T. and Schlechtweg, S. Non-Photorealistic Computer Graphics: Modeling, Rendering, and Animation. Morgan Kaufmann, 2002. Google ScholarDigital Library
- Underkoffler, J., Ullmer, B., and Ishii, H., Emancipated Pixels: Real-World Graphics In The Luminous Room. Proc. SIGGRAPH '99, pp. 385--392. Google ScholarDigital Library
- Utterback, C. Text Rain. http://www.camilleutterback.com/textrain.htmlGoogle Scholar
- Vygotsky, L.S. Mind in Society: Development of Higher Psychological Processes. Harvard University Press, 1978.Google Scholar
- Warren, J. Unencumbered Full Body Interaction in Video Games. Master's Thesis, MFADT Program, Parsons School of Design, 2003.Google Scholar
- Weiser, M., Brown, J.S. The coming age of calm technology. In Denning, P.J., Metcalfe, R.M. (eds.), Beyond Calculation: The Next Fifty Years of Computing. Copernicus, 1998. Google ScholarDigital Library
- Wellner, P. Interacting with paper on the DigitalDesk, Communications of the ACM, v.36 n.7, 87--96, July 1993. Google ScholarDigital Library
- Wilson, A. D. et al. Bringing physics to the surface. UIST '08. ACM, New York, NY, 67--76. 2008. Google ScholarDigital Library
- Zeleznik, R. et al. An object-oriented framework for the integration of interactive animation techniques, ACM SIGGRAPH Computer Graphics, v.25 n.4, 105--112, July 1991. Google ScholarDigital Library
Index Terms
- Social immersive media: pursuing best practices for multi-user interactive camera/projector exhibits
Recommendations
Incorporating Kinesthetic Creativity and Gestural Play into Immersive Modeling
MOCO '17: Proceedings of the 4th International Conference on Movement ComputingThe 3D modeling methods and approach presented in this paper attempt to bring the richness and spontaneity of human kinesthetic interaction in the physical world to the process of shaping digital form, by exploring playfully creative interaction ...
LightBeam: nomadic pico projector interaction with real world objects
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing SystemsPico projectors have lately been investigated as mobile display and interaction devices. We propose to use them as 'light beams': Everyday objects sojourning in a beam are turned into dedicated projection surfaces and tangible interaction devices. While ...
ARTextiles for Promoting Social Interactions Around Personal Interests
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing SystemsOur co-located social relationships are changing with the adoption of new technologies. Augmented Reality (AR) performed on clothing can bridge the gap between our online social media and our face-to-face interactions. We propose a new system composed ...
Comments