skip to main content
10.1145/1099203.1099211acmconferencesArticle/Chapter ViewAbstractPublication PagesgroupConference Proceedingsconference-collections
Article

Benefits of synchronous collaboration support for an application-centered analysis team working on complex problems: a case study

Published: 06 November 2005 Publication History

Abstract

A month-long quasi-experiment was conducted using a distributed team responsible for modeling, simulation, and analysis. Six experiments of three different time durations (short, medium, and long) were performed. The primary goal was to discover if synchronous collaboration capability through a particular application improved the ability of the team to form a common mental model of the analysis problem(s) and solution(s). The results indicated that such collaboration capability did improve the formation of common mental models, both in terms of time and quality (i.e., depth of understanding), and that the improvement did not vary by time duration. In addition, common mental models were generally formed by interaction around a shared graphical image, the progress of collaboration was not linear but episodic, and tasks that required drawing and conversing at the same time were difficult to do.

References

[1]
Buszko, D., W. Lee, & A. Helal. (2001) "Decentralized Ad-Hoc Groupware API and Framework for Mobile Collaboration." Proceedings of the 2001 International ACM SIGGROUP Conference on Supporting Group Work (Group '01), 30 Sept. - 3 October, Boulder, CO, USA, 5--14.
[2]
Campbell, Donald T., & Julian C. Stanley. (1966). Experimental and Quasi-Experimental Designs for Research. Boston: Houghton Mifflin Company.
[3]
Chabert, Annie, Ed Grossman, Larry Jackson, Stephen Pietrowicz, & Chris Seguin. (1998). "Java Object-Sharing in Habanero." Communications of the ACM 41(6), 69--76.
[4]
Chin, George. (2004). "Capturing and Supporting Contexts for Scientific Data Sharing via the Biological Sciences Collaboratory." Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (CSCW 2004), 6-10 November, Chicago, IL, USA, 409--418.
[5]
Disz, Terry. (2001). "The Access Grid Collaboration Environment." Syllabus (April 2001). Available at http://www.campus-technology.com/article.asp?id=3238.
[6]
Doser, Adele B., Peter B. Merkle, Curtis Johnson, Wendell Jones, David Warner, & Tim Murphy. (2003). "Enabling Technology for Human Collaboration." Sandia National Laboratories Technical Report SAND 2003-4225. Available at http://www.bodymedia.com/pdf/sandia-4225.pdf.
[7]
Eidson, Eric D., & Mark A. Ehlen. (2005). "NISAC Agent-Based Laboratory for Economics (N-ABLE™™): Overview of Agent and Simulation Architectures." Sandia National Laboratories Technical Report SAND2005-0263.
[8]
Espinosa, J. Alberto, Robert E. Kraut, Sandra A. Slaughter, Javier F. Lerch, James D. Herbsleb, & Audris Mockus. (2001). "Shared Mental Models and Coordination in Large-Scale, Distributed Software Development." Proceedings of the International Conference on Information Systems (ICIS 2001), 16-19 December, New Orleans, LA, USA, 513--518.
[9]
Espinosa, J. Alberto, Robert E. Kraut, Sandra A. Slaughter, Javier F. Lerch, James D. Herbsleb, & Audris Mockus. (2002). "Shared Mental Models, Familiarity, and Coordination: A Multi-Method Study of Distributed Software Teams." Proceedings of the Twenty-Third International Conference on Information Systems (ICIS 2002), 15-18 December, Barcelona, Spain, 425--433.
[10]
Furmanski, Chris, David Payton, & Mike Daily. (2004). "Quantitative Evaluation Methodology for Dynamic, Web-based Collaboration Tools." Proceedings of the 27th Hawaii International Conference on System Sciences, 5-8 January, Big Island, HI, USA, 50132a.
[11]
Greenberg, Saul, Carl Gutwin, & Andy Cockburn. (1996). "Awareness Through Fisheye Views in Relaxed-WYSIWIS Groupware." Proceedings of the Conference on Graphics Interface, 22-24 May, Toronto, ON, Canada, 28--38.
[12]
Gutwin, Carl, Saul Greenberg, & Mark Roseman. (1996). "Workspace Awareness in Real-Time Distributed Groupware: Framework, Widgets, and Evaluation." People and Computers XI: Proceedings of HCI '96. London: Springer, 281--298.
[13]
http://www.lotus.com/products/product3.nsf/wdocs/ homepage http://www.lotus.com/products/product3.nsf/wdocs/ltwhome
[14]
http://www.webex.com/
[15]
http://www.microsoft.com/windows/netmeeting/ http://www.microsoft.com/office/livemeeting/prodinfo/default.mspx
[16]
Hupfer, Suzanne, Li-Te Cheng, Steven Ross, & John Patterson. (2004). "Introducing Collaboration into an Application Development Environment." Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (CSCW 2004), 6-10 November, Chicago, IL, USA, 21--24.
[17]
Isaacs, Ellen, Alan Walendowski, Steve Whittaker, Diane J. Schiano, & Candace Kamm. (2002). "The Character, Functions, and Styles of Instant Messaging in the Workplace." Proceedings of the 2002 ACM Conference on Computer Supported Cooperative Work (CSCW'02), 16-20 November, New Orleans, LA, USA, 11--20.
[18]
Klimoski, Richard, & Susan Mohammed. (1994). "Team Mental Model: Construct or Metaphor?" Journal of Management 20(2), 403--437.
[19]
Langan-Fox, Janice, Sharon Code, & Kim Langfield-Smith. (2000). "Team Mental Models: Techniques, Methods, and Analytic Approaches." Human Factors 42(2), 242--271.
[20]
Levesque, Laurie L., & Jeanne M. Wilson. (2001). "Cognitive divergence and shared mental models in software development project teams." Journal of Organizational Behavior 22(2), 135--144.
[21]
Linebarger, John M., Christopher D. Janneck, & G. Drew Kessler. (2005). "'Leaving the World Behind:' Supporting Group Collaboration Patterns in a Shared Virtual Environment for Product Design." Scheduled for publication in Presence: Teleoperators and Virtual Environments 14(6).
[22]
Mathieu, John E., Gerald F. Goodwin, Tonia S. Heffner, Eduardo Salas, & Janis A. Cannon-Bowers. (2000). "The Influence of Shared Mental Models on Team Process and Performance." Journal of Applied Psychology 85(2), 273--283.
[23]
McGrath, Joseph E., & Andrea B. Hollingshead. (1994). Groups Interacting With Technology: Ideas, Evidence, Issues, and an Agenda. Sage Library of Social Research 194. Thousand Oaks, CA: SAGE Publications.
[24]
McLeod, Poppy Lauretta. (1992). "An Assessment of the Experimental Literature on the Electronic Support of Group Work: Results of a Meta-Analysis." Human-Computer Interaction 7(3), 257--280.
[25]
Montgomery, Douglas C. (2001). Design and Analysis of Experiments. 5th Edition. New York: John Wiley & Sons.
[26]
Nardi, Bonnie A., Steve Whittaker, & Erin Bradner. (2000). "Interaction and Outeraction: Instant Messaging in Action." Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work (CSCW'00), 2-6 December, Philadelphia, PA, USA, 79--88.
[27]
Noble, David, & Michael Letsky. (2001). "Cognitive-Based Metrics to Evaluate Collaboration Effectiveness." Available at http://www.onr.navy.mil/sci_tech/personnel/342/342_ckm/ pubs/docs/33_mgc_ebr/cognitive_based_metrics.doc.
[28]
Noble, David, Diana Buck, & Jim Yeargain. (2001). "Metrics for Evaluation of Cognitive-Based Collaboration Tools." Proceedings of the 6th International Command and Control Research and Technology Symposium, 19-21 June, Annapolis, MD, USA. Available at http://www.dodccrp.org/events/2001/6th_ICCRTS/Cd/Tracks/Papers/Track6/106_tr6.pdf.
[29]
Procopio, Michael J. (2002). "YCab.NET: Decentralized Collaboration Groupware for Mobile Devices using the Microsoft .NET Framework." Master's of Science Thesis, University of Florida. Available at http://etd.fcla.edu/UF/UFE1000155/procopio_m.pdf
[30]
Rentsch, J. R., & R. J. Hall. (1994). "Members of Great Teams Think Alike: A Model of Team Effectiveness and Schema Similarity Among Team Members." In M. M. Beyerlein & D. A. Johnson, eds., Advances in Interdisciplinary Studies of Work Teams: Theories of Self-Managing Work Teams, Vol. 1 (Greenwich, CT, USA: JAI Press), 223--261.
[31]
Rentsch, Joan R., & Richard J. Klimoski. (2001). "Why do 'great minds' think alike?: antecedents of team member schema agreement." Journal of Organizational Behavior 22(2), 107--120.
[32]
Rouse, William B., & Nancy M. Morris. (1986). "On Looking Into the Black Box: Prospects and Limits in the Search for Mental Models." Psychological Bulletin 100(3), 349--363.
[33]
Shadish, William R., Thomas D. Cook, & Donald T. Campbell. (2002). Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Boston: Houghton Mifflin Company.
[34]
Stefik, M., D. Bobrow, S. Lanning, D. Tatar, & G. Foster. (1987). "WYSIWIS Revised: Experiences with Multi-user Interfaces." ACM Transactions on Office Information Systems 5(2), 147--167.
[35]
Wilson, J. D., N. Hoskin, & J. T. Nosek. (1993). "The Benefits of Collaboration for Student Programmers." Proceedings of the Twenty-fourth SIGCSE Technical Symposium on Computer Science Education, 28-19 February, Indianapolis, IN, USA, 160--164.

Cited By

View all
  • (2024)Mapping leadership, communication and collaboration in short-term distributed teams across various contexts: a scoping reviewBMJ Open10.1136/bmjopen-2023-08187814:10(e081878)Online publication date: 23-Oct-2024
  • (2009)A Session Engine Approach for Synchronous Collaborative EnvironmentsProceedings of the 2009 Seventh International Conference on Creating, Connecting and Collaborating through Computing10.1109/C5.2009.20(144-150)Online publication date: 19-Jan-2009

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
GROUP '05: Proceedings of the 2005 ACM International Conference on Supporting Group Work
November 2005
368 pages
ISBN:1595932232
DOI:10.1145/1099203
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2005

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. benefits of collaboration
  2. collaboration experiments
  3. collaboration frameworks
  4. common mental models
  5. synchronous collaboration

Qualifiers

  • Article

Conference

GROUP05
Sponsor:
GROUP05: ACM 2005 International Conference on Supporting Group Work
November 6 - 9, 2005
Florida, Sanibel Island, USA

Acceptance Rates

Overall Acceptance Rate 125 of 405 submissions, 31%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)18
  • Downloads (Last 6 weeks)1
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Mapping leadership, communication and collaboration in short-term distributed teams across various contexts: a scoping reviewBMJ Open10.1136/bmjopen-2023-08187814:10(e081878)Online publication date: 23-Oct-2024
  • (2009)A Session Engine Approach for Synchronous Collaborative EnvironmentsProceedings of the 2009 Seventh International Conference on Creating, Connecting and Collaborating through Computing10.1109/C5.2009.20(144-150)Online publication date: 19-Jan-2009

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media