NoteLook: taking notes in meetings with digital video and ink

ABSTRACT

NoteLook is a client-server system designed and built to support multimedia note taking in meetings with digital video and ink. It is integrated into a conference room equipped with computer controllable video cameras, video conference camera, and a large display rear video projector. The NoteLook client application runs on wireless pen-based notebook computers. Video channels containing images of the room activity and presentation material are transmitted by the NoteLook servers to the clients, and the images can be interactively and automatically incorporated into the note pages. Users can select channels, snap in large background images and sequences of thumbnails, and write freeform ink notes. A smart video source management component enables the capture of high quality images of the presentation material from a variety of sources. For accessing and browsing the notes and recorded video, NoteLook generates Web pages with links from the images and ink strokes correlated to the video.

REFERENCES

• 1: Gregory D. Abowd , Christopher G. Atkeson , Jason Brotherton , Tommy Enqvist , Paul Gulley , Johan LeMon, Investigating the capture, integration and access problem of ubiquitous computing in an educational setting, Proceedings of the SIGCHI conference on Human factors in computing systems, p.440-447, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274704]
• 2: Gregory D. Abowd , Christopher G. Atkeson , Ami Feinstein , Cindy Hmelo , Rob Kooper , Sue Long , Nitin Sawhney , Mikiya Tani, Teaching and learning as multimedia authoring: the classroom 2000 project, Proceedings of the fourth ACM international conference on Multimedia, p.187-198, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244191]
• 3: G. Cruz , R. Hill, Capturing and playing multimedia events with STREAMS, Proceedings of the second ACM international conference on Multimedia, p.193-200, October 15-20, 1994, San Francisco, California, United States [doi>10.1145/192593.192654]
• 4: Richard C. Davis , James A. Landay , Victor Chen , Jonathan Huang , Rebecca B. Lee , Frances C. Li , James Lin , Charles B. Morrey, III , Ben Schleimer , Morgan N. Price , Bill N. Schilit, NotePals: lightweight note sharing by the group, for the group, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.338-345, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303107]
• 5: Girgensohn, A., Boreczky, J., Wilcox, L., and Foote, J. Facilitating video access by visualizing automatic analysis. Proceedings of lnteract '99. To appear.
• 6: Beverly L. Harrison , Ronald M. Baecker, Designing video annotation and analysis systems, Proceedings of the conference on Graphics interface '92, p.157-166, September 1992, Vancouver, British Columbia, Canada
• 7: Ellen A. Isaacs , Trevor Morris , Thomas K. Rodriguez, A forum for supporting interactive presentations to distributed audiences, Proceedings of the 1994 ACM conference on Computer supported cooperative work, p.405-416, October 22-26, 1994, Chapel Hill, North Carolina, United States [doi>10.1145/192844.193060]
• 8: Lamming, M. and Newman, W. Activity-based information technology in support of personal memory. Technical Report EPC-1991-103, Rank Xerox, EuroPARC, 1991.
• 9: W. E. Mackay, EVA: an experimental video annotator for symbolic analysis of video data, ACM SIGCHI Bulletin, v.21 n.2, p.68-71, Oct. 1989 [doi>10.1145/70609.70617]
• 10: Scott Minneman , Steve Harrison , Bill Janssen , Gordon Kurtenbach , Thomas Moran , Ian Smith , Bill van Melle, A confederation of tools for capturing and accessing collaborative activity, Proceedings of the third ACM international conference on Multimedia, p.523-534, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215316]
• 11: Thomas P. Moran , Patrick Chiu , Steve Harrison , Gordon Kurtenbach , Scott Minneman , William van Melle, Evolutionary engagement in an ongoing collaborative work process: a case study, Proceedings of the 1996 ACM conference on Computer supported cooperative work, p.150-159, November 16-20, 1996, Boston, Massachusetts, United States [doi>10.1145/240080.240243]
• 12: Thomas P. Moran , Leysia Palen , Steve Harrison , Patrick Chiu , Don Kimber , Scott Minneman , William van Melle , Polle Zellweger, “I'll get that off the audio”: a case study of salvaging multimedia meeting records, Proceedings of the SIGCHI conference on Human factors in computing systems, p.202-209, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258704]
• 13: Elin Rønby Pedersen , Kim McCall , Thomas P. Moran , Frank G. Halasz, Tivoli: an electronic whiteboard for informal workgroup meetings, Proceedings of the SIGCHI conference on Human factors in computing systems, p.391-398, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169309]
• 14: Lisa Joy Stifelman , Christopher M. Schmandt, The audio notebook: paper and pen interaction with structured speech, 1997
• 15: R. H. Trigg, Computer support for transcribing recorded activity, ACM SIGCHI Bulletin, v.21 n.2, p.72-74, Oct. 1989 [doi>10.1145/70609.70618]
• 16: Karon Weher , Alex Poon, Marquee: a tool for real-time video logging, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.58-64, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191697]
• 17: Steve Whittaker , Patrick Hyland , Myrtle Wiley, FILOCHAT: handwritten notes provide access to recorded conversations, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.271-277, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191763]
• 18: Lynn D. Wilcox , Bill N. Schilit , Nitin Sawhney, Dynomite: a dynamically organized ink and audio notebook, Proceedings of the SIGCHI conference on Human factors in computing systems, p.186-193, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258700]
• 19: Catherine G. Wolf , James R. Rhyne , Laura K. Briggs, Communication and information retrieval with a pen-based meeting support tool, Proceedings of the 1992 ACM conference on Computer-supported cooperative work, p.322-329, November 01-04, 1992, Toronto, Ontario, Canada [doi>10.1145/143457.143539]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

Additional Classification:
  I. Computing Methodologies
  I.5 PATTERN RECOGNITION

General Terms:
Design, Experimentation, Theory

Keywords:
electronic meeting support, electronic notebook, meeting capture, multimedia applications, note taking, pen computing, video applications