Article

Issues of designing gestures into online interactions: implications for communicating in virtual environments

Author:

Gustav VerhulsdonckAuthors Info & Claims

SIGDOC '07: Proceedings of the 25th annual ACM international conference on Design of communication

Pages 26 - 33

https://doi.org/10.1145/1297144.1297151

Published: 22 October 2007 Publication History

Abstract

This paper describes the use and design of gestures for online virtual environment interactions. Virtual Environments (VEs), are three dimensional virtual worlds that combine sound, text, and gestures in computer-mediated communication (CMC) processes. In VEs, communication can be done through text-based CMC such as instant messaging and chat, but also through additional gestural, visual, proxemic and deictic non-verbal channels. For this reason, VEs require an understanding of the impact of gestures in various contexts. This paper will outline common CMC medium affordances as related to VEs and discuss the importance of using gestures in various online communication contexts. In doing so, this paper will explore the issues that may influence the design and use of gestures for specific professional communication purposes. Because gestures may serve in addressing intercultural contexts and have informational and cognitive communicative benefits within virtual environments, this paper will end with an exploration of specific gesture designs that may help facilitate their use by professional communicators.

References

[1]

Benford, S., Bowers, J., Fahlen, L. E., Greenhalgh, C., and Snowdon, D. User embodiment in collaborative virtual environments. Proceedings of the ACM '95 Conference on Human Factors in Computing Systems. ACM Press, New York, NY, 1995 242--249.

Digital Library

[2]

Bowers, J., Pycock, J. and O'Brien, J. Talk and embodiment in collaborative virtual environments. Proceedings of the ACM CHI '96 Conference on Human Factors in Computing Systems. ACM Press, New York, NY, 1996, 58--66.

Digital Library

[3]

Churchill, E., Snowdon, D., and Munro, J. Collaborative virtual environments: Digital Spaces and Places for CSCW: An Introduction. In E. Churchill, D., Snowdon, and J. Munro, (Eds). Collaborative Virtual Environments: Digital Places and Spaces for Interaction. London, UK, Springer, 2001, 3--17.

[4]

Clark, H., and Brennan, S. Grounding in communication. In L. Resnick, J. Levine and S. Teasley (Eds.), Perspectives on Socially Shared Cognition. American Psychological Assocation, Washington D.C, 1991, 127--149.

[5]

Daft, R. L., and Lengel, R. H. Organizational information requirements, media richness and structural design. Management Science, 32 (5), (1986), 554--571.

Digital Library

[6]

Daft, R. L., Lengel, R. H., and Trevino, L. K. Message equivocality, media selection, and manager performance: Implications for information systems. MIS Quarterly, 11 (3), (1987), 355--366.

Digital Library

[7]

Dennis, A. R., and Valacich, J. S. Rethinking media richness: Towards a theory of media synchronicity. Proceedings of the 32nd Hawaii International Conference on System Sciences. IEEE, Maui, HI, 1999, 1017--1027.

Digital Library

[8]

Dourish, P. and Bellotti, V. Awareness and coordination in shared workspaces. Proceedings of the ACM conference on Computer-Supported Cooperative Work (CSCW) 1992, ACM Press, New York, NY, 1992, 107--114.

Digital Library

[9]

DeSanctis, G., and Poole, M. S. Capturing the Complexity in Advanced Technology Use: Adaptive Structuration Theory. Organization Science, 5(2), (1994), 121--147.

Digital Library

[10]

Evard, R, Churchill, E. F., and Bly, S. Waterfall Glen: Social virtual reality at work. In Collaborative Virtual Environments: Digital Places and Spaces for Interaction. E. Churchill, D., Snowdon, and J. Munro, Eds. Springer, London, UK, 2001, 265--280.

[11]

Fulk, J., Schmitz, J., and Steinfield, C. W. A social influence of technology use. Organizations and Communications Technology. J. Fulk and C. W. Steinfield, Eds. Sage, Newbury Park, CA, 1990, 117--140.

Digital Library

[12]

Gerwing, J and Bavelas, J. B. Linguistic influences on gesture's form. Gesture, 4 (2004), 157--195.

[13]

Goldin-Meadow, S. Hearing gesture: How Our Hands Help Us Think. Harvard University Press, Cambridge, MA, 2003.

[14]

Hall, E. T. Studies in the Anthropology of Visual Communication: Handbook for Proxemic Research. Society for the Anthropology of Visual Communication, Philadelphia, PA, 1974.

[15]

Hall, E. T. The Hidden Dimension. Anchor Doubleday, New York, 1982.

[16]

Hindmarsh, J, Fraser, M., Heath, C., Benford, S. and Greenhalgh, C. Fragmented interaction: Establishing mutual orientation in a virtual environment. Proceedings of the 1998 ACM conference on Computer supported cooperative work. ACM Press, New York, NY, 1998, 217--226.

Digital Library

[17]

Holler, J, and Steven, R. The effect of common ground on how speakers use gesture and speech to represent size information. Journal of Language and Social Psychology, 26 (4), (2007), 4--27.

[18]

Hollingshead, A. B, McGrath, J. E., and O'Connor, K. M. Group task performance and communication technology: A longitudinal study of computer-mediated versus face-to-face work groups. Small Group Research, 24 (3), (1993), 307--333.

[19]

Johnson-Eilola, J. Datacloud: Toward a new theory of online work. Hampton Press, Creskill, NJ, 2005.

[20]

Kock, N. Can communication medium limitations foster better group outcomes? An action research study. Information & Management, 34, (1998), 295--305.

Digital Library

[21]

Kock, N. Evolution and media naturalness: A look at e-communication through a Darwinian theoretical lens. Proceedings of the 23rd International Conference on Information Systems. Assocation for Information Systems, Atlanta, GA, 2002, 372--382.

[22]

Kock, N. Media richness or media naturalness? The evolution of our biological communication apparatus and its influence on our behavior toward e-communication tools. IEEE Transactions on Professional Communication, 48 (2), (2005), 117--130.

[23]

Kock, N. Process improvement and organizational learning: The role of collaboration technologies. Idea Group, Hershey, PA, 1999.

Digital Library

[24]

Kock, N. The ape that used email: Understanding e-communication behavior through evolution theory. Communications of the Assocation for Information Systems, 5 (3), (2001), 1--29.

[25]

Kress, G. Literacy in the New Media Age. Routledge, London, UK, 2003.

[26]

Kress, G. and van Leeuwen, T. Multimodal Discourse: The Modes and Media of Contemporary Communication. Arnold, London, UK, 2001.

[27]

Lakoff, G and Johnson, M. Philosophy in the Flesh. Basic Books, New York, NY, 1999.

[28]

Lanham, R. A. Economics of Attention: Style and Substance in the Age of Information. University of Chicago Press, Chicago, IL, 2005.

Digital Library

[29]

Mehrabian, A. Nonverbal Communication. Aldine-Atherton, Chicago, IL, 1972.

[30]

Mehrabian, A. A semantic space for nonverbal behavior. Journal of Consulting and Clinical Psychology 35, (1970), 248--257.

[31]

McGrath, J. E. Time, interaction, and performance (TIP): A theory of groups. Small Group Research, 22, (1991), 147--174.

[32]

McGrath, J. E. and Gruenfeld, D. H. Toward a dynamic and systemic theory of groups: An integration of six temporally enriched perspectives. Leadership Theory and Research: Perspectives and Directions. M. Chemers and R. Ayman Eds. Academic Press, New York, NY, 1993, 217--243.

[33]

McGrath, J. E. and Hollingshead, A. B. Groups Interacting with Technology. Sage, Thousand Oaks, CA, 1994.

Digital Library

[34]

McGrath, J. E. and Hollingshead, A. B. Putting the "group" back in group support systems: some theoretical issues about dynamic processes in groups with technological enhancements. Group Support Systems: New Perspectives. L. M Jessup and J. S. Valacich, Eds. MacMillan, New York, NY, 1993, 78--96.

[35]

McNeill, D. Gesture and Thought. University of Chicago Press, Chicago, IL, 2005.

[36]

McNeill, D. Hand and Mind: What Gestures Reveal About Mind. University of Chicago Press, Chicago, IL, 1992.

[37]

Olson, G. M., and Olson, J. S. Groupware and computer-supported cooperative work. The Human-computer Interaction Handbook. J. A. Jacko and A. Sears, Eds. Lawrence Erlbaum, Mahwah, NJ, 2003, 583--595.

Digital Library

[38]

Olson, G. M., and Olson, J. S. Human-computer interaction: psychological aspects of the human use of computing. Annual Review of Psychology (2003), 491--517.

[39]

Short, J. A., Williams, E., and Christie, B. The Social Psychology of Telecommunications. Wiley, London, UK, 1976.

[40]

Simon, A. Computer-mediated communication: Task performance and satisfaction. The Journal of Social Psychology 146 (3), (2006), 349--379.

[41]

Sproull, L., and Kiesler, S. Connections: New Ways of Working in the Networked Organization. MIT press, Cambridge, MA, 1992.

Digital Library

[42]

Verhulsdonck, G. and Jeffery, C. Remembrance of things past: Using maps and routes to navigate through virtual environment experiences. Proceedings of the Thirty-Ninth Hawai'i International Conference on Systems Science, ACM Press, New York, NY, 2006. {online: http://doi.ieeecomputersociety.org/10.1109/HICSS.2006.414}

Digital Library

Cited By

Lambrecht KCarradini SLauer CMara A(2024)Developing an Ethical Framework for Virtual Reality Design and Implementation in Technical CommunicationProceedings of the 42nd ACM International Conference on Design of Communication10.1145/3641237.3691649(37-44)Online publication date: 20-Oct-2024
https://dl.acm.org/doi/10.1145/3641237.3691649
Bae SFujiwara TYnnerman ADo ERivera MSzafir D(2024)A Computational Design Pipeline to Fabricate Sensing Network PhysicalizationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332719830:1(913-923)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TVCG.2023.3327198
Chidiac DBowden J(2022)When media matters: the role of media richness and naturalness on purchase intentions within influencer marketingJournal of Strategic Marketing10.1080/0965254X.2022.206203731:6(1178-1198)Online publication date: 21-Apr-2022
https://doi.org/10.1080/0965254X.2022.2062037
Show More Cited By

Index Terms

Issues of designing gestures into online interactions: implications for communicating in virtual environments

Recommendations

Team collaboration in virtual worlds

Are virtual worlds more or less effective for virtual team collaboration? We suggest that the answer to this question is complicated and dependent upon a number of factors, and we propose a research agenda with theoretical bases to guide researchers in ...
Cooperative gestures: multi-user gestural interactions for co-located groupware
CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Multi-user, touch-sensing input devices create opportunities for the use of cooperative gestures -- multi-user gestural interactions for single display groupware. Cooperative gestures are interactions where the system interprets the gestures of more ...
Dynamic Interactions in Physically Realistic Collaborative Virtual Environments

This work describes our efforts in creating a general object interaction framework for dynamic collaborative virtual environments. Furthermore, we increase the realism of the interactive world by using a rigid body simulator to calculate all actor and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGDOC '07: Proceedings of the 25th annual ACM international conference on Design of communication

October 2007

286 pages

ISBN:9781595935885

DOI:10.1145/1297144

General Chair:
David Novick
The University of Texas at El Paso, TX
,
Program Chair:
Clay Spinuzzi
The University of Texas at Austin, TX

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGDOC07

Sponsor:

SIGDOC07: The 25th ACM International Conference on Design of Communication

October 22 - 24, 2007

Texas, El Paso, USA

Acceptance Rates

Overall Acceptance Rate 355 of 582 submissions, 61%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
799
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)1

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lambrecht KCarradini SLauer CMara A(2024)Developing an Ethical Framework for Virtual Reality Design and Implementation in Technical CommunicationProceedings of the 42nd ACM International Conference on Design of Communication10.1145/3641237.3691649(37-44)Online publication date: 20-Oct-2024
https://dl.acm.org/doi/10.1145/3641237.3691649
Bae SFujiwara TYnnerman ADo ERivera MSzafir D(2024)A Computational Design Pipeline to Fabricate Sensing Network PhysicalizationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332719830:1(913-923)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TVCG.2023.3327198
Chidiac DBowden J(2022)When media matters: the role of media richness and naturalness on purchase intentions within influencer marketingJournal of Strategic Marketing10.1080/0965254X.2022.206203731:6(1178-1198)Online publication date: 21-Apr-2022
https://doi.org/10.1080/0965254X.2022.2062037
Verhulsdonck G(2016)Digital Rhetoric and GlobalizationLeadership and Personnel Management10.4018/978-1-4666-9624-2.ch020(431-469)Online publication date: 2016
https://doi.org/10.4018/978-1-4666-9624-2.ch020
Chuang LSuthers D(2016)Behavioral Manifestations of Intercultural Competence in Computer-Mediated Intercultural LearningProceedings of the 2016 49th Hawaii International Conference on System Sciences (HICSS)10.1109/HICSS.2016.264(2085-2094)Online publication date: 5-Jan-2016
https://dl.acm.org/doi/10.1109/HICSS.2016.264
Verhulsdonck G(2014)Digital Rhetoric and GlobalizationDigital Arts and Entertainment10.4018/978-1-4666-6114-1.ch001(1-39)Online publication date: 2014
https://doi.org/10.4018/978-1-4666-6114-1.ch001
Verhulsdonck G(2014)Digital Rhetoric and GlobalizationDigital Rhetoric and Global Literacies10.4018/978-1-4666-4916-3.ch001(1-40)Online publication date: 2014
https://doi.org/10.4018/978-1-4666-4916-3.ch001
Massey AMontoya MWu P(2013)3D Virtual Environments and Corporate LearningProceedings of the 2013 46th Hawaii International Conference on System Sciences10.1109/HICSS.2013.28(893-902)Online publication date: 7-Jan-2013
https://dl.acm.org/doi/10.1109/HICSS.2013.28
Smith PRedfern S(2012)Artificial Intelligence Supported Non-Verbal Communication for Enriched Collaboration in Distributed E-Research EnvironmentsCollaborative and Distributed E-Research10.4018/978-1-4666-0125-3.ch007(135-164)Online publication date: 2012
https://doi.org/10.4018/978-1-4666-0125-3.ch007
Costa CAparício MBraga ACosta CAparicio M(2012)Design of communicationProceedings of the Workshop on Information Systems and Design of Communication10.1145/2311917.2311921(15-19)Online publication date: 11-Jun-2012
https://dl.acm.org/doi/10.1145/2311917.2311921
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten