skip to main content
10.1145/1851600.1851640acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmobilehciConference Proceedingsconference-collections
research-article

User-defined gestures for connecting mobile phones, public displays, and tabletops

Published: 07 September 2010 Publication History

Abstract

Gestures can offer an intuitive way to interact with a computer. In this paper, we investigate the question whether gesturing with a mobile phone can help to perform complex tasks involving two devices. We present results from a user study, where we asked participants to spontaneously produce gestures with their phone to trigger a set of different activities. We investigated three conditions (device configurations): phone-to-phone, phone-to-tabletop, and phone to public display. We report on the kinds of gestures we observed as well as on feedback from the participants, and provide an initial assessment of which sensors might facilitate gesture recognition in a phone. The results suggest that phone gestures have the potential to be easily understood by end users and that certain device configurations and activities may be well suited for gesture control.

References

[1]
Y. Ayatsuka, N. Matsushita, and J. Rekimoto. Hyperpalette: a hybrid computing environment for small computing devices. In CHI '00: CHI '00 extended abstracts on Human factors in computing systems, pages 133--134, New York, NY, USA, 2000. ACM.
[2]
A. Butler, S. Izadi, and S. Hodges. Sidesight: multi-"touch" interaction around small devices. In UIST '08: Proceedings of the 21st annual ACM symposium on User interface software and technology, pages 201--204, New York, NY, USA, 2008. ACM.
[3]
R. Dachselt and R. Buchholz. Natural throw and tilt interaction between mobile phones and distant displays. In CHI EA '09: Proceedings of the 27th international conference extended abstracts on Human factors in computing systems, pages 3253--3258, New York, NY, USA, 2009. ACM.
[4]
H. Gellersen, C. Fischer, D. Guinard, R. Gostner, G. Kortuem, C. Kray, E. Rukzio, and S. Streng. Supporting device discovery and spontaneous interaction with spatial references. Personal Ubiquitous Comput., 13(4):255--264, 2009.
[5]
R. Hardy and E. Rukzio. Touch & interact: touch-based interaction of mobile phones with displays. In MobileHCI '08: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services, pages 245--254, New York, NY, USA, 2008. ACM.
[6]
K. Hinckley. Synchronous gestures for multiple persons and computers. In UIST '03: Proceedings of the 16th annual ACM symposium on User interface software and technology, pages 149--158, New York, NY, USA, 2003. ACM.
[7]
K. Hinckley, G. Ramos, F. Guimbretiere, P. Baudisch, and M. Smith. Stitching: pen gestures that span multiple displays. In AVI '04: Proceedings of the working conference on Advanced visual interfaces, pages 23--31, New York, NY, USA, 2004. ACM.
[8]
M. Karam and M. C. Schraefel. A taxonomy of gesture in human computer interactions. Technical report, Technical Report ECSTR-IAM05-009, Electronics and Computer Science, University of Southampton, 2005.
[9]
J. Kela, P. Korpipää, J. Mäntyjärvi, S. Kallio, G. Savino, L. Jozzo, and D. Marca. Accelerometer-based gesture control for a design environment. Personal Ubiquitous Comput., 10(5):285--299, 2006.
[10]
S. Kratz and M. Rohs. Hoverflow: expanding the design space of around-device interaction. In Proc. of MobileHCI '09, pages 1--8, 2009.
[11]
C. Peng, G. Shen, Y. Zhang, Y. Li, and K. Tan. Beepbeep: a high accuracy acoustic ranging system using cots mobile devices. In SenSys '07: Proceedings of the 5th international conference on Embedded networked sensor systems, pages 1--14, New York, NY, USA, 2007. ACM.
[12]
C. Peng, G. Shen, Y. Zhang, and S. Lu. Point & connect: intention-based device pairing for mobile phone users. In MobiSys '09: Proceedings of the 7th international conference on Mobile systems, applications, and services, pages 137--150, New York, NY, USA, 2009. ACM.
[13]
T. Pering, Y. Anokwa, and R. Want. Gesture connect: facilitating tangible interaction with a flick of the wrist. In TEI '07: Proceedings of the 1st international conference on Tangible and embedded interaction, pages 259--262, New York, NY, USA, 2007. ACM.
[14]
J. Rekimoto. Pick-and-drop: a direct manipulation technique for multiple computer environments. In UIST '97: Proceedings of the 10th annual ACM symposium on User interface software and technology, pages 31--39, New York, NY, USA, 1997. ACM.
[15]
J. Rekimoto. Synctap: synchronous user operation for spontaneous network connection. Personal Ubiquitous Comput., 8(2):126--134, 2004.
[16]
J. Rekimoto and M. Saitoh. Augmented surfaces: a spatially continuous work space for hybrid computing environments. In CHI '99: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 378--385, New York, NY, USA, 1999. ACM.
[17]
J. Rico and S. Brewster. Usable gestures for mobile interfaces: evaluating social acceptability. In Proc. of CHI '10, pages 887--896, 2010.
[18]
C. Swindells, K. M. Inkpen, J. C. Dill, and M. Tory. That one there! pointing to establish device identity. In UIST '02: Proceedings of the 15th annual ACM symposium on User interface software and technology, pages 151--160, New York, NY, USA, 2002. ACM.
[19]
P. Tandler, T. Prante, C. M¨uller-Tomfelde, N. Streitz, and R. Steinmetz. Connectables: dynamic coupling of displays for the flexible creation of shared workspaces. In UIST '01: Proceedings of the 14th annual ACM symposium on User interface software and technology, pages 11--20, New York, NY, USA, 2001. ACM.
[20]
A. D. Wilson and R. Sarin. Bluetable: connecting wireless mobile devices on interactive surfaces using vision-based handshaking. In GI '07: Proceedings of Graphics Interface 2007, pages 119--125, New York, NY, USA, 2007. ACM.
[21]
J. O. Wobbrock, M. R. Morris, and A. D. Wilson. User-defined gestures for surface computing. In CHI '09: Proceedings of the 27th international conference on Human factors in computing systems, pages 1083--1092, New York, NY, USA, 2009. ACM.
[22]
J.-b. Woo and Y.-k. Lim. Contact-and-connect: designing new pairing interface for short distance wireless devices. In CHI EA '09: Proceedings of the 27th international conference extended abstracts on Human factors in computing systems, pages 3655--3660, New York, NY, USA, 2009. ACM.
[23]
K. Yatani, K. Tamura, K. Hiroki, M. Sugimoto, and H. Hashizume. Toss-it: intuitive information transfer techniques for mobile devices. In CHI '05: CHI '05 extended abstracts on Human factors in computing systems, pages 1881--1884, New York, NY, USA, 2005.

Cited By

View all
  • (2024)Sounds Good? Fast and Secure Contact Exchange in GroupsProceedings of the ACM on Human-Computer Interaction10.1145/36869648:CSCW2(1-44)Online publication date: 8-Nov-2024
  • (2024)I've Got the Data in My Pocket! - Exploring Interaction Techniques with Everyday Objects for Cross-Device Data TransferProceedings of Mensch und Computer 202410.1145/3670653.3670778(242-255)Online publication date: 1-Sep-2024
  • (2024)Engineering Touchscreen Input for 3-Way Displays: Taxonomy, Datasets, and ClassificationCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3661331(57-65)Online publication date: 24-Jun-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
MobileHCI '10: Proceedings of the 12th international conference on Human computer interaction with mobile devices and services
September 2010
552 pages
ISBN:9781605588353
DOI:10.1145/1851600
  • General Chairs:
  • Marco de Sá,
  • Luís Carriço,
  • Program Chair:
  • Nuno Correia
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 September 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. device pairing
  2. gesture
  3. large display
  4. mobile phone
  5. multi-device interaction
  6. tabletop
  7. user-defined gesture

Qualifiers

  • Research-article

Conference

MobileHCI '10

Acceptance Rates

MobileHCI '10 Paper Acceptance Rate 46 of 225 submissions, 20%;
Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)22
  • Downloads (Last 6 weeks)1
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Sounds Good? Fast and Secure Contact Exchange in GroupsProceedings of the ACM on Human-Computer Interaction10.1145/36869648:CSCW2(1-44)Online publication date: 8-Nov-2024
  • (2024)I've Got the Data in My Pocket! - Exploring Interaction Techniques with Everyday Objects for Cross-Device Data TransferProceedings of Mensch und Computer 202410.1145/3670653.3670778(242-255)Online publication date: 1-Sep-2024
  • (2024)Engineering Touchscreen Input for 3-Way Displays: Taxonomy, Datasets, and ClassificationCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3661331(57-65)Online publication date: 24-Jun-2024
  • (2024)Designing Upper-Body Gesture Interaction with and for People with Spinal Muscular Atrophy in VRProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642884(1-19)Online publication date: 11-May-2024
  • (2024)User-Defined Interactions for Visual Data Exploration With the Combination of Smartwatch and Large DisplayIEEE Access10.1109/ACCESS.2024.340487612(78657-78679)Online publication date: 2024
  • (2023)ProObjAR: Prototyping Spatially-aware Interactions of Smart Objects with AR-HMDProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580750(1-15)Online publication date: 19-Apr-2023
  • (2023)Volume Controller using Hand Gestures2023 14th International Conference on Computing Communication and Networking Technologies (ICCCNT)10.1109/ICCCNT56998.2023.10308134(1-6)Online publication date: 6-Jul-2023
  • (2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
  • (2022)Eliciting User-Defined Touch and Mid-air Gestures for Co-located Mobile GamingProceedings of the ACM on Human-Computer Interaction10.1145/35677226:ISS(303-327)Online publication date: 14-Nov-2022
  • (2022)User-Elicited Surface and Motion Gestures for Object Manipulation in Mobile Augmented RealityAdjunct Publication of the 24th International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3528575.3551443(1-6)Online publication date: 28-Sep-2022
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media