FaceSpace: endo- and exo-spatial hypermedia in the transparent video facetop

ABSTRACT

The Transparent Video Facetop is a novel user interface concept that supports not only single-user interactions with a PC, but also close pair collaborations, such as that found in collaborative Web browsing, in distributed pair programming and in remote medicine. We recently demonstrated the Vis-a-Vid Facetop prototype as a single-user GUI for manipulating the elements of a traditional WIMP desktop [21]. In this paper we introduce FaceSpace, a Facetop-based hypermedia system that combines structure and functionality of both spatial and ubiquitous hypertext. FaceSpace eliminates camera registration errors due to dynamic object tracking and user self-image feedback. FaceSpace had two forms of linking that combine spatial hypermedia with ubiquitous hypermedia: Like an exo-skeleton provides an organism with structure from without, exo-spatial hypertext has the spatial structure applied over the ubiquity of the user's real-world environment. Endo-spatial hypertext has the spatial structure derived from and attached to the elements of the user's domain. Endo-spatial hypertext is an integral concept in systems that have been classified as ubiquitous hypertext; exo-spatial is unique to FaceSpace in current hypertext systems.

REFERENCES

• 1: Kent Beck, Extreme programming explained: embrace change, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 2: Wells, J. D., "Extreme Programming: A Gentle Introduction," 2001, available on-line at <http://www.extremeprogramming.org/>
• 3: Alistair Cockburn , Laurie Williams, The costs and benefits of pair programming, Extreme programming examined, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2001
• 4: Hiroshi Ishii , Minoru Kobayashi , Jonathan Grudin, Integration of inter-personal space and shared workspace: ClearBoard design and experiments, Proceedings of the 1992 ACM conference on Computer-supported cooperative work, p.33-42, November 01-04, 1992, Toronto, Ontario, Canada [doi>10.1145/143457.143459]
• 5: Robert S. Fish , Robert E. Kraut , Barbara L. Chalfonte, The VideoWindow system in informal communication, Proceedings of the 1990 ACM conference on Computer-supported cooperative work, p.1-11, October 07-10, 1990, Los Angeles, California, United States [doi>10.1145/99332.99335]
• 6: Prashant Baheti , Edward F. Gehringer , P. David Stotts, Exploring the Efficacy of Distributed Pair Programming, Proceedings of the Second XP Universe and First Agile Universe Conference on Extreme Programming and Agile Methods - XP/Agile Universe 2002, p.208-220, August 04-07, 2002
• 7: P.Baheti, L.Williams, E.Gehringer, D.Stotts, "Exploring Pair Programming in Distributed Object-Oriented Team Projects," Educator's Workshop, OOPSLA 2002, Seattle, Nov. 4-8, 2002, accepted to appear.
• 8: Jason McC. Smith , David Stotts , Sang-Uok Kum, An orthogonal taxonomy for hyperlink anchor generation in video streams using OvalTine, Proceedings of the eleventh ACM on Hypertext and hypermedia, p.11-18, May 30-June 03, 2000, San Antonio, Texas, United States [doi>10.1145/336296.336306]
• 9: David Stotts , Jason McC. Smith, Semi-automated Hyperlink markup for archived video, Proceedings of the thirteenth ACM conference on Hypertext and hypermedia, June 11-15, 2002, College Park, Maryland, USA [doi>10.1145/513338.513367]
• 10: Eric A. Bier , Ken Fishkin , Ken Pier , Maureen C. Stone, A taxonomy of see-through tools: the video, Conference companion on Human factors in computing systems, p.411-412, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223355.223753]
• 11: Takahiro Nishi , Yoichi Sato , Hideki Koike, Interactive object registration and recognition for augmented desk interface, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634286]
• 12: Steve Benford , John Bowers , Lennart E. Fahlén , Chris Greenhalgh , Dave Snowdon, User embodiment in collaborative virtual environments, Proceedings of the SIGCHI conference on Human factors in computing systems, p.242-249, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223935]
• 13: Beverly L. Harrison , Hiroshi Ishii , Kim J. Vicente , William A. S. Buxton, Transparent layered user interfaces: an evaluation of a display design to enhance focused and divided attention, Proceedings of the SIGCHI conference on Human factors in computing systems, p.317-324, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223945]
• 14: Vision Interface Seminar, Fall 2001, MIT, <http://www.ai.mit.edu/~trevor/6.892/>
• 15: Vision Interface Seminar, Fall 2001, MIT, <http://www.ai.mit.edu/~trevor/6.892/>
• 16: Ivan Laptev , Tony Lindeberg, Tracking of Multi-state Hand Models Using Particle Filtering and a Hierarchy of Multi-scale Image Features, Proceedings of the Third International Conference on Scale-Space and Morphology in Computer Vision, p.63-74, July 07-08, 2001
• 17: Stotts, D., L. Wiliams, et al., "Virtual Teaming: Experiments and Experiences with Distributed Pair Programming," TR03-003, Dept. of Computer Science, Univ. of North Carolina at Chapel Hill, March 1, 2003.
• 18: Stotts, D., J. McC. Smith, and D. Jen, "The Vis-a-Vid Transparent Video FaceTop," UIST '03, Vancouver, Nov. 3-6, 2004, pp. 57--58.
• 19: Stotts, D., S. Kim, J. Navon, J. Prins, and L. Nyland, "CobWeb: Visual Design of Collaboration Protocols for Dynamic Group Web Browsing," Visual Computing 2002 (Distributed Multimedia 2002), San Francisco, Sept. 26-28, 2002, pp. 595--598.
• 20: Esenther, A.W., "Instant Co-Browsing: Lightweight Real-time Collaborative Web Browsing", Proc. of WWW 2002, <http://www2002.org/CDROM/poster/86/>.
• 21: P. David Stotts , Richard Furuta, Petri-net-based hypertext: document structure with browsing semantics, ACM Transactions on Information Systems (TOIS), v.7 n.1, p.3-29, Jan. 1989 [doi>10.1145/64789.64791]
• 22: Richard Furuta , David Stotts, Dynamic hyperdocuments: authoring replaces programming, Communications of the ACM, v.38 n.8, p.111-112, Aug. 1995 [doi>10.1145/208344.208370]
• 23: P. David Stotts , Richard Furuta , Cyrano Ruiz Cabarrus, Hyperdocuments as automata: verification of trace-based browsing properties by model checking, ACM Transactions on Information Systems (TOIS), v.16 n.1, p.1-30, Jan. 1998 [doi>10.1145/267954.267955]
• 24: Richard Furuta , P. David Stotts, Interpreted collaboration protocols and their use in groupware prototyping, Proceedings of the 1994 ACM conference on Computer supported cooperative work, p.121-131, October 22-26, 1994, Chapel Hill, North Carolina, United States [doi>10.1145/192844.192888]
• 25: Frank Shipman , J. Michael Moore , Preetam Maloor , Haowei Hsieh , Raghu Akkapeddi, Semantics happen: knowledge building in spatial hypertext, Proceedings of the thirteenth ACM conference on Hypertext and hypermedia, June 11-15, 2002, College Park, Maryland, USA [doi>10.1145/513338.513350]
• 26: Frank Shipman , Andreas Girgensohn , Lynn Wilcox, Combining spatial and navigational structure in the hyper-hitchcock hypervideo editor, Proceedings of the fourteenth ACM conference on Hypertext and hypermedia, August 26-30, 2003, Nottingham, UK [doi>10.1145/900051.900078]
• 27: Kaj Grønbæk , Peter Posselt Vestergaard , Peter Ørbæk, Towards geo-spatial hypermedia: Concepts and prototype implementation, Proceedings of the thirteenth ACM conference on Hypertext and hypermedia, June 11-15, 2002, College Park, Maryland, USA [doi>10.1145/513338.513370]
• 28: Jason McC. Smith , David Stotts , Sang-Uok Kum, An orthogonal taxonomy for hyperlink anchor generation in video streams using OvalTine, Proceedings of the eleventh ACM on Hypertext and hypermedia, p.11-18, May 30-June 03, 2000, San Antonio, Texas, United States [doi>10.1145/336296.336306]
• 29: David Stotts , Jason McC. Smith, Semi-automated Hyperlink markup for archived video, Proceedings of the thirteenth ACM conference on Hypertext and hypermedia, June 11-15, 2002, College Park, Maryland, USA [doi>10.1145/513338.513367]
• 30: CoVitess, <http://iihm.imag.fr/demos/CoVitesse/> .
• 31: Twiki, <http://twiki.org/> .
• 32: Patrick Sinclair , Kirk Martinez , David E. Millard , Mark J. Weal, Links in the palm of your hand: tangible hypermedia using augmented reality, Proceedings of the thirteenth ACM conference on Hypertext and hypermedia, June 11-15, 2002, College Park, Maryland, USA [doi>10.1145/513338.513371]
• 33: Kaj Grønbæk , Jannie F. Kristensen , Peter Ørbæk , Mette Agger Eriksen, "Physical hypermedia": organising collections of mixed physical and digital material, Proceedings of the fourteenth ACM conference on Hypertext and hypermedia, August 26-30, 2003, Nottingham, UK [doi>10.1145/900051.900056]
• 34: Luis Romero , Nuno Correia, HyperReal: a hypermedia model for mixed reality, Proceedings of the fourteenth ACM conference on Hypertext and hypermedia, August 26-30, 2003, Nottingham, UK [doi>10.1145/900051.900055]
• 35: Norbert A. Streitz , Jörg Geißler , Jörg M. Haake , Jeroen Hol, DOLPHIN: integrated meeting support across local and remote desktop environments and LiveBoards, Proceedings of the 1994 ACM conference on Computer supported cooperative work, p.345-358, October 22-26, 1994, Chapel Hill, North Carolina, United States [doi>10.1145/192844.193044]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: Architectures

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities; Video (e.g., tape, disk, DVI)
      H.5.4 Hypertext/Hypermedia
          Subjects: Theory; Navigation

General Terms:
Design, Experimentation, Human Factors

Keywords:
augmented reality, hypermedia, hypertext, transparency, video