"Physical hypermedia": organising collections of mixed physical and digital material

ABSTRACT

This paper addresses the problem of organizing material in mixed digital and physical environments. It presents empirical examples of how people use collectional artefacts and organize physical material such as paper, samples, models, mock-ups, plans, etc. in the real world. Based on this material, we propose concepts for collectional actions and meta-data actions, and present prototypes combining principles from augmented reality and hypermedia to support organising and managing mixtures of digital and physical materials. The prototype of the tagging system is running on digital desks and walls utilizing Radio Frequency IDentifier (RFID) tags and tag-readers. It allows users to tag important physical materials, and have these tracked by antennas that may become pervasive in our work environments. We work with three categories of tags: simple object tags, collectional tags, and tooltags invoking operations such as grouping and linking of physical material. Our primary application domain is architecture and design, thus we discuss use of augmented collectional artefacts primarily for this domain.

REFERENCES

• 1: Proceedings of the 3rd international conference on Ubiquitous Computing, September 2001
• 2: Monika Büscher , Michael Christensen , Kaj Grønbæk , Peter Krogh , Preben Mogensen , Dan Shapiro , Peter Ørbæk, Collaborative augmented reality environments: integrating VR, working materials, and distributed work spaces, Proceedings of the third international conference on Collaborative virtual environments, p.47-56, September 2000, San Francisco, California, United States [doi>10.1145/351006.351012]
• 3: Büscher, M., Mogensen, P., & Shapiro D. Spaces of Practice. In W. Prinz et al. (Ed.), Proceedings of the Seventh European Conference on Computer Supported Cooperative Work.. Bonn, Germany: Kluwer Academic Publishers, 2001, pp. 139--158.
• 4: Paul Castro , Patrick Chiu , Ted Kremenek , Richard R. Muntz, A Probabilistic Room Location Service for Wireless Networked Environments, Proceedings of the 3rd international conference on Ubiquitous Computing, p.18-34, September 30-October 02, 2001, Atlanta, Georgia, USA
• 5: Gibson, J. J. The Ecological Approach to Visual Perception. Boston: Houghton Mifflin, 1979.
• 6: Kaj Grøbæk , Randall H. Trigg, From Web to workplace: designing open hypermedia systems, MIT Press, Cambridge, MA, 1999
• 7: GGrönbæk, K., Gundersen, K.K., Mogensen, P. & ØØrbæk, P. Interactive Room Support for Complex and Distributed Design Projects. In proc. of Interact 2001, Tokyo Japan, July 2001.
• 8: Kaj Grønbæk , Morten Kyng , Preben Mogensen, CSCW challenges: cooperative design in engineering projects, Communications of the ACM, v.36 n.6, p.67-77, June 1993 [doi>10.1145/153571.163272]
• 9: Kaj Grønbæk , Peter Posselt Vestergaard , Peter Ørbæk, Towards geo-spatial hypermedia: Concepts and prototype implementation, Proceedings of the thirteenth ACM conference on Hypertext and hypermedia, June 11-15, 2002, College Park, Maryland, USA [doi>10.1145/513338.513370]
• 10: Hideki Koike , Yoichi Sato , Yoshinori Kobayashi , Hiroaki Tobita , Motoki Kobayashi, Interactive textbook and interactive Venn diagram: natural and intuitive interfaces on augmented desk system, Proceedings of the SIGCHI conference on Human factors in computing systems, p.121-128, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332415]
• 11: Wendy E. Mackay, Augmented reality: linking real and virtual worlds: a new paradigm for interacting with computers, Proceedings of the working conference on Advanced visual interfaces, May 24-27, 1998, L'Aquila, Italy [doi>10.1145/948496.948498]
• 12: Wendy E. Mackay , Guillaume Pothier , Catherine Letondal , Kaare Bøegh , Hans Erik Sørensen, The missing link: augmenting biology laboratory notebooks, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.571992]
• 13: W. Mark, Turning pervasive computing into mediated spaces, IBM Systems Journal, v.38 n.4, p.677-692, Dec. 1999
• 14: Catherine C. Marshall , Frank M. Shipman, III, Spatial hypertext and the practice of information triage, Proceedings of the eighth ACM conference on Hypertext, p.124-133, April 06-11, 1997, Southampton, United Kingdom [doi>10.1145/267437.267451]
• 15: Catherine C. Marshall , Frank G. Halasz , Russell A. Rogers , William C. Janssen, Jr., Aquanet: a hypertext tool to hold your knowledge in place, Proceedings of the third annual ACM conference on Hypertext, p.261-275, December 15-18, 1991, San Antonio, Texas, United States [doi>10.1145/122974.123000]
• 16: Preben Mogensen , Kaj Grønbæk, Hypermedia in the virtual project room - toward open 3D spatial hypermedia, Proceedings of the eleventh ACM on Hypertext and hypermedia, p.113-122, May 30-June 03, 2000, San Antonio, Texas, United States [doi>10.1145/336296.336340]
• 17: Donald A. Norman, The invisible computer, MIT Press, Cambridge, MA, 1998
• 18: Jun Rekimoto , Masanori Saitoh, Augmented surfaces: a spatially continuous work space for hybrid computing environments, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.378-385, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303113]
• 19: George Robertson , Maarten van Dantzich , Daniel Robbins , Mary Czerwinski , Ken Hinckley , Kirsten Risden , David Thiel , Vadim Gorokhovsky, The Task Gallery: a 3D window manager, Proceedings of the SIGCHI conference on Human factors in computing systems, p.494-501, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332482]
• 20: Tomas Sokoler , Håkan Edeholt, Physically embodied video snippets supporting collaborative exploration of video material during design sessions, Proceedings of the second Nordic conference on Human-computer interaction, October 19-23, 2002, Aarhus, Denmark [doi>10.1145/572020.572037]
• 21: Norbert A. Streitz , Jörg Geißler , Jörg M. Haake , Jeroen Hol, DOLPHIN: integrated meeting support across local and remote desktop environments and LiveBoards, Proceedings of the 1994 ACM conference on Computer supported cooperative work, p.345-358, October 22-26, 1994, Chapel Hill, North Carolina, United States [doi>10.1145/192844.193044]
• 22: Norbert A. Streitz , Jörg Geißler , Torsten Holmer, Roomware for Cooperative Buildings: Integrated Design of Architectural Spaces and Information Spaces, Proceedings of the First International Workshop on Cooperative Buildings, Integrating Information, Organization, and Architecture, p.4-21, February 01, 1998
• 23: Proceedings of the 2nd international symposium on Handheld and Ubiquitous Computing, September 2000
• 24: Brygg Ullmer , Hiroshi Ishii, mediaBlocks: tangible interfaces for online media, CHI '99 extended abstracts on Human factors in computing systems, May 15-20, 1999, Pittsburgh, Pennsylvania [doi>10.1145/632716.632739]
• 25: Brygg Ullmer , Hiroshi Ishii , Dylan Glas, mediaBlocks: physical containers, transports, and controls for online media, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.379-386, July 1998 [doi>10.1145/280814.280940]
• 26: Ullmer,B., & Ishii, H. Emerging Frameworks for Tangible User Interfaces. In Human-Computer Interaction in the New Millenium, Ed. J. M. Carroll, Addison-Wesley ACM-press, New York, 2002, pp. 579--598.
• 27: Brygg Ullmer , Hiroshi Ishii, The metaDESK: models and prototypes for tangible user interfaces, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.223-232, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263551]
• 28: Roy Want , Kenneth P. Fishkin , Anuj Gujar , Beverly L. Harrison, Bridging physical and virtual worlds with electronic tags, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.370-377, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303111]
• 29: Mark Weiser, Some computer science issues in ubiquitous computing, Communications of the ACM, v.36 n.7, p.75-84, July 1993 [doi>10.1145/159544.159617]
• 30: Pierre Wellner, Interacting with paper on the DigitalDesk, Communications of the ACM, v.36 n.7, p.87-96, July 1993 [doi>10.1145/159544.159630]
• 31: Pierre Wellner , Wendy Mackay , Rich Gold, Back to the real world, Communications of the ACM, v.36 n.7, p.24-27, July 1993 [doi>10.1145/159544.159555]
• 32: Craig Wisneski , Hiroshi Ishii , Andrew Dahley , Matthew G. Gorbet , Scott Brave , Brygg Ullmer , Paul Yarin, Ambient Displays: Turning Architectural Space into an Interface between People and Digital Information, Proceedings of the First International Workshop on Cooperative Buildings, Integrating Information, Organization, and Architecture, p.22-32, February 01, 1998

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities
      H.5.4 Hypertext/Hypermedia

General Terms:
Design, Documentation, Experimentation

Keywords:
augmented reality, collections of materials, physical and digital, spatial hypermedia, tagging