poster

Evaluation of user gestures in multi-touch interaction: a case study in pair-programming

Authors:

Alessandro Soro,

Samuel Aldo Iacolina,

Riccardo Scateni,

Selene UrasAuthors Info & Claims

ICMI '11: Proceedings of the 13th international conference on multimodal interfaces

Pages 161 - 168

https://doi.org/10.1145/2070481.2070508

Published: 14 November 2011 Publication History

Abstract

Natural User Interfaces are often described as familiar, evocative and intuitive, predictable, based on common skills. Though un-questionable in principle, such definitions don't provide the de-signer with effective means to design a natural interface or evalu-ate a design choice vs another. Two main issues in particular are open: (i) how do we evaluate a natural interface, is there a way to measure 'naturalness'; (ii) do natural user interfaces provide a concrete advantage in terms of efficiency, with respect to more tradi-tional interface paradigms? In this paper we discuss and compare observations of user behavior in the task of pair programming, performed at a traditional desktop versus a multi-touch table. We show how the adoption of a multi-touch user interface fosters a significant, observable and measurable, increase of nonverbal communication in general and of gestures in particular, that in turn appears related to the overall performance of the users in the task of algorithm understanding and debugging.

References

[1]

Bolt R. A.: "Put-that-there": Voice and gesture at the graphics interface . In Proc. Of SIGGRAPH '80: the 7th annual conference on Computer graphics and interactive techniques

Digital Library

[2]

Bruegger, P. and Hirsbrunner, B. Kinetic User Interface: Interaction through Motion for Pervasive Computing Systems, in Proc. of the 5th International on ConferenceUniversal Access in Human-Computer Interaction. UAHCI '09

Digital Library

[3]

Castellano, G. and Kessous, L. and Caridakis, G. Emotion Recognition through Multiple Modalities: Face, Body Gesture, Speech. in: Affect and Emotion in Human-Computer In-teraction: From Theory to Applications (2008)

Digital Library

[4]

Goldin-Meadow, S., Nusbaum, H., Kelly, S.D., & Wagner, S. (2001). Explaining math: Gesturing lightens the load. Psychological Science, 12, 516--522.

[5]

Han J. Y.: Low-cost multi-touch sensing through frustrated total internal reflection. In UIST '05: Proceedings of the 18th annual ACM symposium on User interface software and technology (New York, NY, USA, 2005), ACM, pp. 115--118

Digital Library

[6]

Ishii, H., and Ullmer, B. Tangible bits: towards seamless interfaces between people, bits and atoms. In CHI '97: Pro-ceedings of the SIGCHI conference on Human factors in computing systems, pages 234--241, New York, NY, USA, 1997. ACM.

Digital Library

[7]

Kasday L. R., NJ P.: Touch position sensitive surface, 1981/12/23 1984. 3

[8]

Kendon, A. 2004. Gesture: Visible Action as Utterance. Cambridge University Press

[9]

Kirsh, D. and Maglio, P. On Distinguishing Epistemic from Pragmatic Action. Cognitive Science 18, 513--549 (1994)

[10]

Krueger M. W., Gionfriddo T., Hinrichsen K.: Videoplace--an artificial reality. SIGCHI Bull. 16, 4 (1985), 35--40. 3

Digital Library

[11]

Lee S., Buxton W., Smith K. C.: A multi-touch three dimen-sional touch-sensitive tablet. SIGCHI Bull. 16, 4 (1985), 21--25. 3

Digital Library

[12]

Maglio P. P., Kirsh D.: Epistemic action increases with skill. In In Proceedings of the Eighteenth Annual Conference of the Cognitive Science Society (1996), Erlbaum, pp. 391--396. 3

[13]

McNeill, D. Hand and Mind: What Gestures Reveal About Thought. University of Chicago Press, Chicago. 1992.

[14]

Morrison, C., Jones, M., Blackwell, A., Vuylsteke, A. (2008) Electronic patient record use during ward rounds: a qualitative study of interaction between medical staff, Critical Care 2008

[15]

Owen, R. Gordon Kurtenbach, George Fitzmaurice, Thomas Baudel, and Bill Buxton. 2005. When it gets more difficult, use both hands: exploring bimanual curve manipulation. In Proceedings of Graphics Interface 2005 (GI '05). Canadian Human-Computer Communications Society, School of Com-puter Science, University of Waterloo, Waterloo, Ontario, Canada, 17--24.

Digital Library

[16]

Patten, J and Ishii, H. 2000. A comparison of spatial organi-zation strategies in graphical and tangible user interfaces. In Proceedings of DARE 2000 on Designing augmented reality environments (DARE '00). ACM, New York, NY, USA, 41--50.

Digital Library

[17]

Pavlovic V. I., Sharma R., Huang T. S.: Visual interpretation of hand gestures for human-computer interaction: A review. IEEE Trans. Pattern Anal. Mach. Intell. 19, 7 (1997), 677--695.

Digital Library

[18]

Williams, L. and Kessle, R. 2002. Pair Programming Illuminated. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA.

Digital Library

[19]

Wilson, A. D. and Hrvoje Benko. 2010. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In Proceedings of the 23nd annual ACM symposium on User interface software and technology (UIST '10). ACM, New York, NY, USA, 273--282.

Digital Library

[20]

Wu Y., Huang T. S.: Vision-based gesture recognition: A review. In GW '99: Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction (London, UK, 1999), Springer-Verlag, pp. 103--115.

Digital Library

[21]

Zeleznik, R., Andrew Bragdon, Ferdi Adeputra, and Hsu-Sheng Ko. 2010. Hands-on math: a page-based multi-touch and pen desktop for technical work and problem solving. In Proceedings of the 23nd annual ACM symposium on User interface software and technology (UIST '10). ACM, New York, NY, USA, 17--26.

Digital Library

[22]

Cook, S. W., Mitchell, Z., Goldin-Meadow, S. (2008). Gesturing makes learning last. Cognition, 106, 1047--1058.

[23]

Kipp, M. (to appear) Multimedia Annotation, Querying and Analysis in ANVIL. In: M. Maybury (ed.) Multimedia In-formation Extraction, Chapter 19, IEEE Computer Society Press

[24]

Love, T. ANSI C for Programmers on UNIX Systems. Cambridge University Engineering Department (available online: ftp://svr-www.eng.cam.ac.uk/misc/love_C.ps.Z)

Cited By

Kim YReza MMcGrenere JYoon DKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Designers Characterize Naturalness in Voice User Interfaces: Their Goals, Practices, and ChallengesProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445579(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445579
Lanzilotti RArdito CCostabile MDe Angeli ADesolda G(2015)DMS2015-26Journal of Visual Languages and Computing10.1016/j.jvlc.2015.10.02031:PB(206-214)Online publication date: 1-Dec-2015
https://dl.acm.org/doi/10.1016/j.jvlc.2015.10.020
Pedrosa DGuimarães Rda Graça Pimentel MBulterman DCesar PShin SMaldonado J(2013)Interactive coffee table for exploration of personal photos and videosProceedings of the 28th Annual ACM Symposium on Applied Computing10.1145/2480362.2480548(967-974)Online publication date: 18-Mar-2013
https://dl.acm.org/doi/10.1145/2480362.2480548
Show More Cited By

Index Terms

Evaluation of user gestures in multi-touch interaction: a case study in pair-programming
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Design and evaluation of interaction models for multi-touch mice
GI '10: Proceedings of Graphics Interface 2010

Adding multi-touch sensing to the surface of a mouse has the potential to substantially increase the number of interactions available to the user. However, harnessing this increased bandwidth is challenging, since the user must perform multi-touch ...
Single capacitive touch sensor that detects multi-touch gestures
ISWC '14: Proceedings of the 2014 ACM International Symposium on Wearable Computers

A technique that allows a single capacitive touch sensor to recognize multi-touch gestures is proposed. Touch, multi-finger swipe and swipe direction are recognized. It does not need a multiplexer or complicated wiring and well suits wearable devices. ...
Comparing Tangible and Multi-touch Interaction for Interactive Data Visualization Tasks
TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction

Interactive visualization plays a key role in the analysis of large datasets. It can help users to explore data, investigate hypotheses and find patterns. The easier and more tangible the interaction, the more likely it is to enhance understanding. This ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '11: Proceedings of the 13th international conference on multimodal interfaces

November 2011

432 pages

ISBN:9781450306416

DOI:10.1145/2070481

General Chairs:
Hervé Bourlard
Idiap Research Institute, Switzerland
,
Thomas S. Huang
University of Illinois, USA
,
Enrique Vidal
Universitat Politécnica Valéncia, Spain
,
Program Chairs:
Daniel Gatica-Perez
Idiap Research Institute, Switzerland
,
Louis-Philippe Morency
University of Southern California, USA
,
Nicu Sebe
University of Trento, Italy

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

ICMI'11

Sponsor:

SIGCHI

ICMI'11: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 14 - 18, 2011

Alicante, Spain

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
348
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)1

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kim YReza MMcGrenere JYoon DKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Designers Characterize Naturalness in Voice User Interfaces: Their Goals, Practices, and ChallengesProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445579(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445579
Lanzilotti RArdito CCostabile MDe Angeli ADesolda G(2015)DMS2015-26Journal of Visual Languages and Computing10.1016/j.jvlc.2015.10.02031:PB(206-214)Online publication date: 1-Dec-2015
https://dl.acm.org/doi/10.1016/j.jvlc.2015.10.020
Pedrosa DGuimarães Rda Graça Pimentel MBulterman DCesar PShin SMaldonado J(2013)Interactive coffee table for exploration of personal photos and videosProceedings of the 28th Annual ACM Symposium on Applied Computing10.1145/2480362.2480548(967-974)Online publication date: 18-Mar-2013
https://dl.acm.org/doi/10.1145/2480362.2480548
Anslow CMarshall SNoble JBiddle R(2013)SourceVis: Collaborative software visualization for co-located environments2013 First IEEE Working Conference on Software Visualization (VISSOFT)10.1109/VISSOFT.2013.6650527(1-10)Online publication date: Sep-2013
https://doi.org/10.1109/VISSOFT.2013.6650527

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten