Support for multitasking and background awareness using interactive peripheral displays

ABSTRACT

In this paper, we describe Kimura, an augmented office environment to support common multitasking practices. Previous systems, such as Rooms, limit users by constraining the interaction to the desktop monitor. In Kimura, we leverage interactive projected peripheral displays to support the perusal, manipulation and awareness of background activities. Furthermore, each activity is represented by a montage comprised of images from current and past interaction on the desktop. These montages help remind the user of past actions, and serve as a springboard for ambient context-aware reminders and notifications.

REFERENCES

• 1: Monika Büscher , Preben Mogensen , Dan Shapiro , Ina Wagner, The Manufaktur: supporting work practice in (landscape) architecture, Proceedings of the Sixth European conference on Computer supported cooperative work, p.21-40, August 1999, Copenghagen, Denmark
• 2: Buxton, W. (1995) "Integrating the Periphery and Context: A New Model of Telematics" In Proceedings of Graphics Interface '95, pp. 239-245.
• 3: Cohen, P. R., Cheyer, A., Wang, M., and Baeg, S. C. (1994) "An open agent architecture", in AAAI Spring Symposium, pp. 1-8, Mar. 1994.
• 4: CoolTown home page, http://www.cooltown.hp.com/
• 5: Steven Feiner , Blair MacIntyre , Marcus Haupt , Eliot Solomon, Windows on the world: 2D windows for 3D augmented reality, Proceedings of the 6th annual ACM symposium on User interface software and technology, p.145-155, December 1993, Atlanta, Georgia, United States [doi>10.1145/168642.168657]
• 6: Steven Feiner , Ari Shamash, Hybrid user interfaces: breeding virtually bigger interfaces for physically smaller computers, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.9-17, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120783]
• 7: D. Austin Henderson, Jr. , Stuart Card, Rooms: the use of multiple virtual workspaces to reduce space contention in a window-based graphical user interface, ACM Transactions on Graphics (TOG), v.5 n.3, p.211-243, July 1986 [doi>10.1145/24054.24056]
• 8: Jason I. Hong , James A. Landay, SATIN: a toolkit for informal ink-based applications, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.63-72, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354412]
• 9: Horvitz, E., Breese, J., Heckerman, D., Hovel, D., and Rommelse, K. (1998). ''The Lumiere Project: Bayesian User Modeling for Inferring the Goals and Needs of Software Users," In Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence, July 1998.
• 10: Hutchins, E. (1995) Cognition in the Wild, Cambridge, MA, MIT Press.
• 11: iButton home page. http://www.ibunon.com/.
• 12: Hiroshi Ishii , Brygg Ullmer, Tangible bits: towards seamless interfaces between people, bits and atoms, Proceedings of the SIGCHI conference on Human factors in computing systems, p.234-241, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258715]
• 13: Johanson, B., Fox, A., Hanrahan, P., and Winograd, T. (2000) "The Event Heap: An Enabling Infrastructure for Interactive Workspaces", available at http://graphics.stanford.edu/ papers/eheap/
• 14: László Szirmay-Kalos, Dynamic layout algorithm to display general graphs, Graphics gems IV, Academic Press Professional, Inc., San Diego, CA, 1994
• 15: Blair MacIntyre , Steven Feiner, Language-level support for exploratory programming of distributed virtual environments, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.83-94, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237104]
• 16: Richard Mander , Gitta Salomon , Yin Yin Wong, A “pile” metaphor for supporting casual organization of information, Proceedings of the SIGCHI conference on Human factors in computing systems, p.627-634, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.143055]
• 17: Miyata, Y., and Norman, D. A. (1986) "Psychological Issues in Support of Multiple Activites," In User Centered Design, D. A. Norman and S. W. Draper, eds., Lawrence Erlbaum, NJ, pp. 265-284.
• 18: Thomas P. Moran , Patrick Chiu , Steve Harrison , Gordon Kurtenbach , Scott Minneman , William van Melle, Evolutionary engagement in an ongoing collaborative work process: a case study, Proceedings of the 1996 ACM conference on Computer supported cooperative work, p.150-159, November 16-20, 1996, Boston, Massachusetts, United States [doi>10.1145/240080.240243]
• 19: Elizabeth D. Mynatt , Takeo Igarashi , W. Keith Edwards , Anthony LaMarca, Flatland: new dimensions in office whiteboards, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.346-353, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303108]
• 20: Mynatt, E. D. (1999) "Writing on the Wall," Proceedings of INTERACT '99. pp. 196-204.
• 21: Ramesh Raskar , Greg Welch , Matt Cutts , Adam Lake , Lev Stesin , Henry Fuchs, The office of the future: a unified approach to image-based modeling and spatially immersive displays, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.179-188, July 1998 [doi>10.1145/280814.280861]
• 22: Jun Rekimoto, Time-machine computing: a time-centric approach for the information environment, Proceedings of the 12th annual ACM symposium on User interface software and technology, p.45-54, November 07-10, 1999, Asheville, North Carolina, United States [doi>10.1145/320719.322582]
• 23: Jun Rekimoto , Masanori Saitoh, Augmented surfaces: a spatially continuous work space for hybrid computing environments, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.378-385, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303113]
• 24: Rhodes, B.J. (1997) "The Wearable Remembrance Agent: A system for augmented memory," in Personal Technologies Journal Special Issue on Wearable Computing, Personal Technologies 1(4), pp. 218-224.
• 25: George Robertson , Maarten van Dantzich , Daniel Robbins , Mary Czerwinski , Ken Hinckley , Kirsten Risden , David Thiel , Vadim Gorokhovsky, The Task Gallery: a 3D window manager, Proceedings of the SIGCHI conference on Human factors in computing systems, p.494-501, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332482]
• 26: Daniel Salber , Anind K. Dey , Gregory D. Abowd, The context toolkit: aiding the development of context-enabled applications, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.434-441, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303126]
• 27: Norbert A. Streitz , Jörg Geißler , Torsten Holmer , Shin'ichi Konomi , Christian Müller-Tomfelde , Wolfgang Reischl , Petra Rexroth , Peter Seitz , Ralf Steinmetz, i-LAND: an interactive landscape for creativity and innovation, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.120-127, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303010]
• 28: P. Wyckoff , S. W. McLaughry , T. J. Lehman , D. A. Ford, T spaces, IBM Systems Journal, v.37 n.3, p.454-474, 1998

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Additional Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.1 Office Automation

General Terms:
Design

Keywords:
Context-aware computing, Rooms, ambient displays, office computing, ubiquitous computing