System guidelines for co-located, collaborative work on a tabletop display

ABSTRACT

Collaborative interactions with many existing digital tabletop systems lack the fluidity of collaborating around a table using traditional media. This paper presents a critical analysis of the current state-of-the-art in digital tabletop systems research, targeted at discovering how user requirements for collaboration are currently being met and uncovering areas requiring further development. By considering research on tabletop displays, collaboration, and communication, several design guidelines for effective co-located collaboration around a tabletop display emerged. These guidelines suggest that technology must support: (1) natural interpersonal interaction, (2) transitions between activities, (3) transitions between personal and group work, (4) transitions between tabletop collaboration and external work, (5) the use of physical objects, (6) accessing shared physical and digital objects, (7) flexible user arrangements, and (8) simultaneous user interactions. The critical analysis also revealed several important directions for future research, including: standardization of methods to evaluate co-located collaboration; comparative studies to determine the impact of existing system configurations on collaboration; and creation of a taxonomy of collaborative tasks to help determine which tasks and activities are suitable for tabletop collaboration.

References

1. Aiello, J.R. (1987). Human Spatial Behavior. In D. Stokols & I. Altman (eds.): Handbook of Environmental Psychology, vol. 1, Toronto, ON: John Wiley & Sons, pp. 389-505.
2. Agrawala, M., Beers, A.C., Fröhlich, B., Hanrahan, P., MacDowall, I., and Bolas, M. (1997). The Two-User Responsive Workbench: Support for Collaboration through Individual Views of a Shared Space. In Proceedings of the ACM Conference on Computer Graphics and Interactive Techniques (SIGGRAPH)'97, pp. 327-332.
3. Arias, E.G., Eden, H., and Fischer, G. (1997). Enhancing Communication, Facilitating Shared Understanding, and Creating Better Artifacts by Integrating Physical and Computational Media for Design. In Proceedings of the Symposium on Designing Interactive Systems (DIS)'97, pp. 1-12.
4. Arias, E.G., Eden, H., Fischer, G., Gorman, A., and Scharff, E. (1999). Beyond Access: Informed Participation and Empowerment. In Proceedings of the Conference on Computer-Supported Collaborative Learning (CSCL)'99, pp. 20-32.
5. Bekker, M.M., Olson, J.S., and Olson, G.M. (1995). Analysis of gestures in face-to-face design teams provides guidance for how to use groupware in design. In Proceedings of the Symposium on Designing Interactive Systems (DIS)'95, pp. 157-166.
6. Bly, S.A. (1988). A Use of Drawing Surfaces in Different Collaborative Settings. In Proceedings of the ACM Conference on Computer-Supported Cooperative Work (CSCW)'88, pp. 250-256.
7. Bier, E.A., & Freeman, S. (1991). MMM: A User Interface Architecture for Shared Editors on a Single Screen. In Proceedings of ACM Symposium on User Interface Software Technology (UIST)'91, pp. 79-86.
8. Bricker, L.J., Bennett, M.J., Fujioke, E., & Tanimoto, S.L. (1999). Colt: A System for Developing Software that Supports Synchronous Collaborative Activities. In Proceedings of Educational Media (EdMedia)'99, pp. 587-592.
9. Buxton, W., Fitzmaurice, G.W., Balakrishnan, R., and Kurtenbach, G. (2000). Large Displays in Automotive Design. In IEEE Computer Graphics and Applications, 20(4), pp. 68-75.
10. Carletta, J., Isard, A., Isard, S., Kowtko, J.C., Doherty-Sneddon, G., & Anderson, A.H. (1997). The reliability of a dialogue structure coding scheme. In Computational Linguistics, 23, pp. 13-31.
11. Cockburn, A. & Greenberg, S. (1996). Children's Collaboration Styles in a Newtonian Microworld. In Conference Companion of ACM Conference on Human Factors in Computing Systems (CHI)'96, pp. 181-182.
12. Cutler, L.D., Fröhlich, B., and Hanrahan, P. (1997). Two-Handed Direct Manipulation on the Responsive Workbench. In Proceedings 1997 Symposium on Interactive 3D Graphics. pp. 107-114.
13. Deitz, P. and Leigh, D. (2001). DiamondTouch: A Multi-User Touch Technology. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST) 2000, pp. 219-226.
14. Eden, H., Hornecker, E., and Scharff, E. (2002). Multilevel Design and Role Play: Experiences in Assessing Support for Neighborhood Participation in Design. In Proceedings of the Symposium on Designing Interactive Systems (DIS) 2002, pp. 387-392.
15. Elwart-Keys, M., Halonen, D., Horton, M., Kass, R., and Scott, P. (1990). User Interface Requirements for Face to Face Groupware. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI) '90, pp. 295-301.
16. Fitzmaurice, G.W., Ishii, H., and Buxton, W. (1995). Bricks: Laying the Foundations for Graspable User Interfaces. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI)'95. pp. 442-449.
17. Fitzmaurice, G.W., Balakrishan, R., Kurtenbach, G., and Buxton, B. (1999). An Exploration into Supporting Artwork Orientation in the User Interface. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI)'99, pp. 167-174.
18. Fjeld, M., Voorhorst, F., Bichsel, M., Krueger, H., and Rauterberg, M. (2000). Navigation Methods for an Augmented Reality System. In Extended Abstracts of ACM Conference on Human Factors in Computing Systems (CHI)'00, pp. 8-9.
19. Fox, A., Johanson, B., Hanrahan, P., and Winograd, T. (2000). Integrating Information Appliances into an Interactive Workspace. IEEE Computer Graphics and Applications, 20(4), pp. 54-65.
20. Gale, C. (1998). 'The Effects of Gaze Awareness on Dialogue in a Video-Based Collaborative Manipulative Task,' in Conference Summary of the ACM Conference on Human Factors in Computing Systems (CHI)'98, pp. 345-346.
21. Grant, K.D., Graham, A., Nguyen, T., Paepcke, A. and Winograd, T. (2003). Beyond the Shoe Box: Foundations for Flexibly Organizing Photographs on a Computer. Submitted for Publication. http://dbpubs.stanford.edu:8090/pub/2003-3.
22. Grant, K.D. and Winograd, T. (2002). Flexible, Collaborative Organization on a Tabletop. In CSCW2002 Workshop on Co-located Tabletop Collaboration: Technologies and Directions.
23. Gutwin, C., & Greenberg, S. (2000). The Mechanics of Collaboration: Developing Low Cost Usability Evaluation Methods for Shared Workspaces. In IEEE 9th International Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE'00).
24. Gutwin, C., Greenberg, S., and Roseman, M. (1996). Workspace Awareness in Real-time Distributed Groupware: Framework, Widgets, & Evaluation. In Proceedings of the HCI'96, pp. 281-298.
25. Hall, E.T. (1966). Distances in Man: The Hidden Dimension. Double Day, Garden City, NY.
26. Hall, E.T. (1974). Proxemics. In S. Weitz (ed.), Nonverbal Communication: Readings with Commentary, Oxford University Press, Toronto, ON.
27. Hancock, M.S. (2001). A Feed Forward Neural Network for Determining a User's Location. Simon Fraser University Technical Report TR 2001-2. December, 2001.
28. Inkpen, K., Booth, K.S., Klawe, M., Upitis, R. (1995). Playing together beats playing apart, especially for girls. In Proceedings of the Conference on Computer-Supported Collaborative Learning (CSCL)'95, pp. 177-181.
29. Ishii, H. Wisneski, C., Orbanes, J., Chun, B., and Paradiso., J. (1999). PingPongPlus: Design of an Athletic-Tangible Interface for Computer-Supported Cooperative Play. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI)'99, pp. 394-401.
30. Johanson, B., Hutchins, G., Winograd, T., Stone, M. (2002). PointRight: Experience with Flexible Input Redirection in Interactive Workspaces. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST) 2002, pp. 227-234.
31. Klemmer, S.R., Newman, M., Farrell, F., Meza, R., and Landay, J.A. (2000). A Tangible Difference: Participatory Design Studies Informing a Designers' Outpost. In CSCW2000 Workshop on Shared Environments to Support Face-to-Face Collaboration.
32. Koike, H., Sato, Y., Kobayashi, Y., Tobita, H., and Kobayashi, M. (2000). Interactive Textbook and Interactive Venn Diagram: Natural and Intuitive Interfaces on Augmented Desk System. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI) 2000, pp. 121-128.
33. Kruger, R., & Carpendale, M.S.T. (2002). Orientation and Gesture on Horizontal Displays. UbiCOMP 2002 Workshop on Collaboration with Interactive Walls and Tables.
34. Kyffin, S., Living Memory Project Brochure, Philips Design. (2000). http://www.design.philips.com/lime/download/brochure.pdf
35. Leibe, B., Starner, T., Ribarsky, W., Wartell, T, Krum, D., Singletary, B., and Hodges L. (2000). The Perceptive Workbench: Towards Spontaneous and Natural Interaction in Semi-Immersive Virtual Environments. In Proceedings of the IEEE Conference on Virtual Reality 2000. pp. 13-20.
36. Luff, P., Heath, C., and Greatbatch, D. (1992). Tasks-in-Interaction: Paper and Screen Based Documentation in Collaborative Activity. In Proceedings of the ACM Conference on Computer-Supported Cooperative Work (CSCW)'92, pp. 163-170.
37. Mackay, W., Velay, G., Carter, K., Ma, C., and Pagani, D. (1993). Augmenting Reality: Adding Computational Dimensions to Paper, In Communications of the ACM 36(7), pp. 96-97.
38. Mandryk, R.L., Maranan, D.S., and Inkpen, K.M. (2002). False Prophets: Exploring Hybrid Board/Video Games. In Extended Abstracts of ACM Conference on Human Factors in Computing Systems (CHI) 2002. pp. 640-641.
39. Mandviwalla, M. and Olfman, L. (1994). What Do Groups Need? A Proposed Set of Generic Groupware Requirements. In ACM Transactions on Computer-Human Interaction, 1(3), pp. 245-268.
40. Olson, G.M., Olson, J.S., Carter, M., & Storrøøsten, M. (1992). Small group design meetings: An analysis of collaboration. In Human-Computer Interaction, 7, pp. 347-374.
41. Omojola, O., Post, E.R., Hancher, M.D., Maguire, Y., Pappu, R., Schoner, B., Russo, P.R., Gershenfeld, N., and Fletcher, R. (2000). An Installation of Interactive Furniture. In IBM Systems Journal, 39(3/4) pp. 861-879.
42. Patten, J., Ishii, H., Hines, J., and Pangaro, G. (2001). A wireless object tracking platform for tangible user interfaces. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI) 2001. pp. 253-260.
43. Rauterberg, M., Bichsel, M., Leonhardt, U., and Meier, M. (1997). BUILD-IT: a computer vision-based interaction technique of a planning tool for construction and design. In Proceedings of the IFIP International Conference on Human-Computer Interaction (INTERACT)'97. pp. 587-588.
44. Rekimoto, J. and Saitoh, M. (1999). Augmented Surfaces: A Spatially Continuous Work Space for Hybrid Computing Environments. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI)'99, pp. 378-385.
45. Rekimoto, J., Ullmer, B., and Oba, H. (2001). DataTiles: a modular platform for mixed physical and graphical interactions. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI) 2001, pp. 269-276.
46. Rekimoto, J. (2002). SmartSkin: An infrastructure for freehand manipulation on interactive surfaces. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI) 2002, pp. 113-120.
47. Scott, S.D., Lesh, N., and Klau, G.W. (2002). Investigating human-computer optimization. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI) 2002, pp. 155-162.
48. Scott, S., Grant, K., Carpendale, S., Inkpen, K., Mandryk, R., & Winograd, T. (2002). Co-located Tabletop Collaboration: Technologies and Directions. Workshop at CSCW2002 (In Extended Abstracts of the ACM Conference on Computer-Supported Cooperative Work (CSCW)'02, p. 21.).
49. Scott, S.D., Mandryk, R.L., & Inkpen, K.M. (2003). Understanding Children's Collaborative Interactions in Shared Environments. In Journal of Computer-Aided Learning. (in press).
50. Shen, C., Lesh, N., Vernier, F., Forlines, C., & Frost, J. (2002), Sharing and Building Digital Group Histories. In Proceedings of the ACM Conference on Computer-Supported Cooperative Work (CSCW) 2002, pp. 324-333.
51. Sommer, R. (1969). Personal space: The behaviour basis of design. Prentice-Hall, Englewood Cliffs, N.J.
52. Ståhl, O., Wallberg, A., Sderberg, J., Humble, J., Fahln, L.E., Lundberg, J., Bullock, A. (2002). Information Exploration Using the Pond. In Proceedings of the Conference on Collaborative Virtual Environments (CVE) 2002, pp. 72-79.
53. Stewart, J., Bederson, B.B, and Druin, A. (1999). Single Display Groupware: A Model for Copresent Collaboration. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI)'99, pp. 286-293.
54. Streitz, N., Prante, T., Mueller-Tomfelde, C., Tandler, P., and Magerkurth, C. (2002). Roomware - The Second Generation. In Extended Abstracts of ACM Conference on Human Factors in Computing Systems (CHI) 2002, pp. 506-507.
55. Streitz, N.A., Geißler, J., Holmer, T., Konomi, S., Müller-Tomfelde, C., Reischl, W., Rexroth, P., Seitz, P., Steinmetz, R., Steinmetz, R., and Steinmetz, R. (1999). i-LAND: An interactive Landscape for Creativitiy and Innovation. In Proceedings of the the ACM Conference on Human Factors in Computing Systems (CHI)'99, pp. 120-127.
56. Suzuki, H. and Kato, H. (1995). Interaction-Level Support for Collaborative Learning: AlgoBlock - Open Programming Language. In Proceedings of the Conference on Computer-Supported Collaborative Learning (CSCL)'95, pp. 349-355.
57. Tandler, P., Prante, T., Müller-Tomfelde, C., Streitz, N., and Steinmetz, R. (2001). ConnecTables: Dynamic Coupling of Displays for the Flexible Creation of Shared Workspaces. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST) 2001, pp. 11-19.
58. Tang, J.C. (1991). Findings from observational studies of collaborative work. In International Journal of Man-Machine Studies, 34, pp. 143-160.
59. Tatar, D.G., Foster, G., and Bobrow, D.G. (1991). Design for Conversation: Lessons from Cognoter. In International Journal of Man-Machine Studies, 34, pp. 185-209.
60. Thompson, J.J. (1973). Beyond Words: nonverbal communication in the classroom. New York: Citation Press.
61. Ullmer, B. and Ishii, H. (1997). The metaDESK: Models and prototypes for tangible user interfaces. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST) 1997, pp. 223-232.
62. Underkoffler, J. and Ishii, H. (1999). Urp: A luminous-tangible workbench for urban planning and design. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI) 99, pp. 386-393.
63. Wellner, P. (1993). Interacting with Paper on the DigitalDesk. Communications of the ACM, 36(7), pp. 86-96.

Index Terms

• Human-centered computing

  • Collaborative and social computing

    • Collaborative and social computing theory, concepts and paradigms

      • Computer supported cooperative work

  • Human computer interaction (HCI)

    • Interaction devices

      • Touch screens

    • Interaction paradigms

  • Interaction design

• Social and professional topics

  • Professional topics

    • Computing and business

      • Computer supported cooperative work