Do visualizations improve synchronous remote collaboration?

ABSTRACT

Information visualizations can improve collaborative problem solving, but this improvement may depend on whether visualizations promote communication. In an experiment on the effect of network visualizations, remote pairs worked synchronously to identify a serial killer. They discussed disparate evidence distributed across the pair using IM. Four conditions, respectively, offered (a) spreadsheet only (controls), (b) individual unshared visualizations, (c) view-only shared visualizations, and (d) a full-access shared visualization of all evidence. We examined collaborative performance, use of the visualization tool, and communication as a function of condition. All visualization conditions improved remote collaborators' performance over the control condition. Full access to a shared visualization best facilitated remote collaboration by encouraging tool use and fostering discussion between the partners. Shared visualization without full access impaired performance somewhat and made communication even more vital to identifying the serial killer. This study provides direct evidence of visualization tool features and partner behavior that promote collaboration.

REFERENCES

• 1: Andrews, K., & Heidegger, H. (1998). Information Slices: Visualization and Exploring Large Hierarchies using Cascading, Semi-Circular Discs. Proc. Information Visualization 1998. NJ: IEEE press.
• 2: Ariely, D. (2000). Controlling the information flow: Effects on consumers' decision making and preferences. Journal of Consumer Research, 27, 233--248.
• 3: Baron, R. A. (2006). Opportunity recognition as pattern recognition: How entrepreneurs "connect the dots" to identify new business opportunities. Academy of Management Perspectives, 20(1), 104--119.
• 4: Billman, D., Convertino, G., Pirolli, P., Massar, J. P. and Shrager, J. (2005). Collaborative intelligence analysis with CACHE: Bias reduction and information coverage. Unpublished manuscript. Palo Alto Research Center, CA. Retrieved from http://cscl.ist.psu.edu/public/users/gconvert/mypapers/hcic2006_BillmanEtAl.pdf.
• 5: Peter C.-H. Cheng , Ric K. Lowe , Mike Scaife, Cognitive Science Approaches To UnderstandingDiagrammatic Representations, Artificial Intelligence Review, v.15 n.1-2, p.79-94, March 2001
• 6: William J. Clancey, Situated cognition: how representations are created and given meaning, Proceedings of the IFIP TC3/WG3.3 Working Conference on Lessons from Learning, p.231-242, September 06-08, 1993
• 7: Edelson, D., Pea, R., Gomez, L. (1996). Constructive in the Collaboratory. In B.G. Wilson (Ed.), Constructivist Learning Environments: Case Studies in Instructional Design. Englewood Cliffs, NJ: Educational Technology Publications.
• 8: Fiore, S., Salas, E., Cuevas, H., & Bowers, C. (2003). Distributed coordination space: toward a theory of distributed team process and performance. Theoretical Issues in Ergonomics Science, 4(3), 340--364.
• 9: Fraidin, S. N. (2004). When is one head better than two? Interdependent information in group decision making. Organizational Behavior and Human Decision Processes, 93(2), 102--113.
• 10: Fredericks, S. (2005). Cognitive reflection and decision making. Journal of Economic Perspectives, 19, 25--42.
• 11: Carl Gutwin , Saul Greenberg, Design for individuals, design for groups: tradeoffs between power and workspace awareness, Proceedings of the 1998 ACM conference on Computer supported cooperative work, p.207-216, November 14-18, 1998, Seattle, Washington, United States [doi>10.1145/289444.289495]
• 12: Hart, S. G., & Staveland, L. E. (1988). Development of a multi-dimensional workload rating scale: Results of empirical and theoretical research. In P. A. Hancock & N. Meshkati (Ed.), Human mental workload (pp. 139--183). Amsterdam: Elsevier.
• 13: Jeffrey Heer , Fernanda B. Viégas , Martin Wattenberg, Voyagers and voyeurs: supporting asynchronous collaborative information visualization, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240781]
• 14: T. Dean Hendrix , James H. Cross, II , Saeed Maghsoodloo , Matthew L. McKinney, Do visualizations improve program comprehensibility? experiments with control structure diagrams for Java, ACM SIGCSE Bulletin, v.32 n.1, p.382-386, Mar. 2000
• 15: Hill, G. (1982). Group versus individual performance: Are N+ 1 heads better than one. Psychological Bulletin, 91(3), 517--539.
• 16: Hosmer, D. W., & Lemeshow, S. (1989). Applied Logistic Regression. NY: John Wiley & Sons.
• 17: Huerer, Jr., R. J. (1999). The psychology of intelligence. Washington DC: Center for the Study of Intelligence, Government Printing Office.
• 18: Johnston, R. (2005). Analytic culture in the U.S. intelligence community: An ethnographic study. Washington DC: Center for the Study of Intelligence, Government Printing Office.
• 19: Klahr, D., & Simon, H. A. (1999). Studies of scientific creativity: Complementary approaches and convergent findings. Psychological Bulletin, 125, 524--543.
• 20: Kraut, R. E., Fussell, S. R., Brennan, S. E., & Siegel, J. (2002). Understanding effects of proximity on collaboration: Implications for technologies to support remote collaborative work. In P. Hinds & S. Kiesler (Eds.), Distributed work, 137--162. Cambridge, MA: MIT Press.
• 21: Larkin, J., & Simon, H. (1987). Why a Diagram is (Sometimes) Worth Ten Thousand Words. Cognitive Science, 11(1), 65--100.
• 22: Lavery, T., Franz, T., Winquist, J., & Larson, J. (1999). The Role of Information Exchange in Predicting Group Accuracy on a Multiple Judgment Task. Basic and Applied Social Psychology, 21(4), 281--289.
• 23: Gloria Mark , Keri Carpenter , Alfred Kobsa, Are there benefits in seeing double?: a study of collaborative information visualization, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.766023]
• 24: Gloria Mark , Keri Carpenter , Alfred Kobsa, A Model of Synchronous Collaborative Information Visualization, Proceedings of the Seventh International Conference on Information Visualization, p.373, July 16-18, 2003
• 25: Mark, G., Kobsa, A., & Gonzalez, V. (2002). Do four eyes see better than two? Collaborative versus individual discovery in data visualization systems. Proc. Information Visualization 2002 (pp. 249--255), NJ: IEEE Press.
• 26: Mohammed, S., & Dumville, B. (2001). Team mental models in a team knowledge framework: expanding theory and measurement across disciplinary boundaries. Journal of Organizational Behavior, 22(2), 89--106.
• 27: Monk, A. (2003). Common ground in electronically mediated communication: Clark's theory of language use. In J.M. Carroll (Ed.), HCI Models, Theories and Frameworks: Towards a Multidisiplinary Science (pp. 265--289). San Francisco, CA: Morgan Kaufmann.
• 28: Alex Pang , Craig Wittenbrink, Collaborative 3D Visualization with CSpray, IEEE Computer Graphics and Applications, v.17 n.2, p.32-41, March 1997 [doi>10.1109/38.574676 ]
• 29: Kathy Ryall , Clifton Forlines , Chia Shen , Meredith Ringel Morris, Exploring the effects of group size and table size on interactions with tabletop shared-display groupware, Proceedings of the 2004 ACM conference on Computer supported cooperative work, November 06-10, 2004, Chicago, Illinois, USA [doi>10.1145/1031607.1031654]
• 30: Safarik, M. E., Jarvis, J., & Nussbaum, K. (2000). Elderly female serial sexual homicide. Homicide Studies, 4, 294--307.
• 31: Peter Scupelli , Sara Kiesler , Susan R. Fussell , Congrui Chen, Project view IM: a tool for juggling multiple projects and teams, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1057019]
• 32: Ben Shneiderman, The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations, Proceedings of the 1996 IEEE Symposium on Visual Languages, p.336, September 03-06, 1996
• 33: Simonton, D. K. (2003). Scientific creativity as constrained stochastic behavior: The integration of product, person, and process perspectives. Psychological Bulletin, 129, 475--494.
• 34: John Stasko, An evaluation of space-filling information visualizations for depicting hierarchical structures, International Journal of Human-Computer Studies, v.53 n.5, p.663-694, Nov. 2000 [doi>10.1006/ijhc.2000.0420 ]
• 35: Stasser, G., & Titus, W. (1987). Effects of information load and percentage of shared information on the dissemination of unshared information during group discussion. Journal of personality and social psychology, 53(1), 81--93.
• 36: State of North Carolina v. Henry Louis Wallace, 2000. URL: www.aoc.state.nc.us/www/public/sc/opinions/2000/241-97-1.htm. Downloaded June 16, 2007.
• 37: Suthers, D., & Hundhausen, C. (2001). Learning by Constructing Collaborative Representations: An Empirical Comparison of Three Alternatives. Proc. Euro CSCL 2001 (pp. 577--592). Maastricht, the Netherlands: Maastricht McLuhan Institute.
• 38: Tolcott, M. A., Marvin, F. F., and Bresoick, T. A. (1989). The confirmation bias in military situation assessment. Reston, VA: Decision Science Consortium.
• 39: Aravindan Veerasamy , Nicholas J. Belkin, Evaluation of a tool for visualization of information retrieval results, Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval, p.85-92, August 18-22, 1996, Zurich, Switzerland [doi>10.1145/243199.243218]
• 40: Fernanda B. Viégas , Martin Wattenberg , Kushal Dave, Studying cooperation and conflict between authors with history flow visualizations, Proceedings of the SIGCHI conference on Human factors in computing systems, p.575-582, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985765]
• 41: Martin Wattenberg, Visualizing the stock market, CHI '99 extended abstracts on Human factors in computing systems, May 15-20, 1999, Pittsburgh, Pennsylvania [doi>10.1145/632716.632834]
• 42: Wickens, C. D., & Carswell, C. M. (1995). The proximity compatibility principle: Its psychological foundation and its relevance to display design. Human Factors, 37, 473--494.
• 43: Wright, D.B. (2007). Calculating nominal group statistics in collaboration studies. Behavior Research Methods, 39, 460--470.
• 44: Zhang, J., & Norman, D. (1994). Representations in Distributed Cognitive Tasks. Cognitive Science, 18(1), 87--122.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Computer-supported cooperative work

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Synchronous interaction

General Terms:
Experimentation, Theory

Keywords:
collaboration, communication, cscw, distributed work, empirical studies, information visualization