Social and physical interactive paradigms for mixed-reality entertainment

ABSTRACT

This article outlines an overview of new paradigms in social and physical interaction in mixed-reality entertainment. Social and physical interactions are constrained, and thus natural interactions are lost in most current digital entertainment systems. In order to regain natural interactions, we argue that mixed-reality technology has great potential for promoting social and physical interactions. In this article we present five research prototype systems, Magic Land, Human Pacman, Kyoto Garden, Poultry Internet, and Free Network Visible Network (FNVN), to explain methods to regain natural social and physical interactions in mixed-reality entertainment. We believe these systems are part of a new form of entertainment based on physicality, mobility, tangible social interaction, and ubiquitous computing. Some details, benefits, and issues regarding design are discussed.

REFERENCES

• 1: Association, E. S. 2002. Essential facts about the computer and video game industry. Online: http://www.theesa.com/pressroom.html.
• 2: Bowlby, J. 1983. Attachment and Loss, Vol. I: Attachment. Basic Books, New York, 1983.
• 3: Cheok, A. D., Fong, S. W., Goh, K. H., Yang, X., Liu, W., Farzbiz, F., and Li, Y. 2003. Human pacman: A mobile entertainment system with ubiquitous computing and tangible interaction over a wide outdoor area. In Proceedings of the Fifth International Symposium on Human Computer Interaction with Mobile Devices and Services, 209 - 223.
• 4: Adrian David Cheok , Siew Wan Fong , Kok Hwee Goh , Xubo Yang , Wei Liu , Farzam Farzbiz, Human Pacman: a sensing-based mobile entertainment system with ubiquitous computing and tangible interaction, Proceedings of the 2nd workshop on Network and system support for games, p.106-117, May 22-23, 2003, Redwood City, California [doi>10.1145/963900.963911]
• 5: Cheok, A. D., Xu, K., Liu, W., Teo, H. S., Teo, S. L., Lee, S. P., Katai, O., Kawakami, H., and Notsu, A. 2004. Mixed reality media for social and physical interaction. In Proceedings of the International Conference on Artificial Reality and Telexistence, 79 - 84.
• 6: Adrian David Cheok , Kok Hwee Goh , Wei Liu , Farzam Farbiz , Siew Wan Fong , Sze Lee Teo , Yu Li , Xubo Yang, Human Pacman: a mobile, wide-area entertainment system based on physical, social, and ubiquitous computing, Personal and Ubiquitous Computing, v.8 n.2, p.71-81, May 2004 [doi>10.1007/s00779-004-0267-x]
• 7: Cheok, A. D., Teo, H. S., and Teo, S. L. 2004. Does pacman need a helper? Analyzing experience of physical and social interactivity in a mixed reality entertainment environment. In Proceedings of the CHI 2004 Conference.
• 8: Cheok, A. D., Xu, K., Liu, W., Notsu, A., and Katai, O. 2005. Ubiquitous human media for interactive sandplay therapy. In Proceedings of the Second International Workshop on the Ubiquitous Home (Sept. 2005).
• 9: Chris Crawford, Live: what a concept! ... networked games, Digital illusion: entertaining the future with high technology, ACM Press/Addison-Wesley Publishing Co., New York, NY, 1998
• 10: Where the action is: the foundations of embodied interaction, MIT Press, Cambridge, MA, 2001
• 11: Farbiz, F., Cheok, A. D., Wei, L., Zhiying, Z., Ke, X., Prince, S., Billinghurst, M., and Kato, H. 2005. Live three-dimensional content for augmented reality. IEEE Trans. Multimedia 7, 3 (June 2005), 514 - 523.
• 12: FreeNetwork. 2006. Online: http://www.freenetworks.org.
• 13: Wendy Hall, Ending the Tyranny of the Button, IEEE MultiMedia, v.1 n.1, p.60-68, March 1994 [doi>10.1109/93.295269 ]
• 14: Hiroshi Ishii , Brygg Ullmer, Tangible bits: towards seamless interfaces between people, bits and atoms, Proceedings of the SIGCHI conference on Human factors in computing systems, p.234-241, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258715]
• 15: Lee Shang Ping , Farzam Farbiz , Adrian David Cheok, Touchy.Internet: a cybernetics system for human-pet interaction through the Internet, ACM SIGGRAPH 2003 Sketches & Applications, July 27-31, 2003, San Diego, California [doi>10.1145/965400.965499]
• 16: Lee, S. P., Farbiz, F., and Cheok, A. D. 2004. A humanpet interactive entertainment system over the internet. In Proceedings of the International Conference on Entertainment Computing. 509 - 512.
• 17: Carsten Magerkurth , Timo Engelke , Maral Memisoglu, Augmenting the virtual domain with physical and social elements: towards a paradigm shift in computer entertainment technology, Computers in Entertainment (CIE), v.2 n.4, October 2004 [doi>10.1145/1037851.1037870]
• 18: Mandryk, R. L. and Inkpen, K. M. 2001. Supporting free play in ubiquitous computer games. In Proceedings of the Workshop on Designing Ubiquitous Computing Games (UbiComp 2001, Oct. 2001).
• 19: MXRToolkit. 2006. Online: http://sourceforge.net/projects/mxrtoolkit/.
• 20: Schatten-Jones, E. 2002. Psychological well-being and day-to-day social interaction among older adults. Personal Relationships 9 (2002), 57 - 71.
• 21: Ta Huynh Duy Nguyen , Tran Cong Thien Qui , Ke Xu , Adrian David Cheok , Sze Lee Teo , ZhiYing Zhou , Asitha Mallawaarachchi , Shang Ping Lee , Wei Liu , Hui Siang Teo , Le Nam Thang , Yu Li , Hirokazu Kato, Real-Time 3D Human Capture System for Mixed-Reality Art and Entertainment, IEEE Transactions on Visualization and Computer Graphics, v.11 n.6, p.706-721, November 2005 [doi>10.1109/TVCG.2005.105]
• 22: Simon Prince , Adrian David Cheok , Farzam Farbiz , Todd Williamson , Nik Johnson , Mark Billinghurst , Hirokazu Kato, 3D Live: Real Time Captured Content for Mixed Reality, Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR'02), p.7, September 30-October 01, 2002
• 23: Schulzrinne, H., Casner, S. L., Frederick, R., and Jacobson, V. 1996. Rtp: A transport protocol for realtime applications. Internet Engineering Task Force, Audio-Video Transport Working Group (Jan. 1996).
• 24: Christopher B. Stapleton , Charles E. Hughes , J. Michael Moshell, MIXED FANTASY: Exhibition of Entertainment Research for Mixed Reality, Proceedings of the The 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, p.354, October 07-10, 2003
• 25: Lucy A. Suchman, Plans and situated actions: the problem of human-machine communication, Cambridge University Press, New York, NY, 1987
• 26: Warchalking. 2006. Online: http://www.warchalking.org.
• 27: Weiser, M. 1991. The computer for the twenty-first century. In Scientific American, 94 - 104.
• 28: Xu, K., Cheok, A. D., Liu, W., Lee, S. P., Teo, S. L., Teo, H. S., and Kato, H. 2005. Mixed reality human centered media for social and physical interaction and entertainment. In Proceedings of the 11th International Conference on Human-Computer Interaction, vol. 6.
• 29: Zhang, Z., and Shan, Y. 2001. State of the industry report. available at: http://www.theesa.com/pressroom.html.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

Additional Classification:
  J. Computer Applications
  J.5 ARTS AND HUMANITIES
      Subjects: Fine arts

General Terms:
Design

Keywords:
mixed-reality entertainment, multiuser games, role-play, social and physical interaction