skip to main content
10.1145/1449715.1449746acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article

SideSight: multi-"touch" interaction around small devices

Published: 19 October 2008 Publication History

Abstract

Interacting with mobile devices using touch can lead to fingers occluding valuable screen real estate. For the smallest devices, the idea of using a touch-enabled display is almost wholly impractical. In this paper we investigate sensing user touch around small screens like these. We describe a prototype device with infra-red (IR) proximity sensors embedded along each side and capable of detecting the presence and position of fingers in the adjacent regions. When this device is rested on a flat surface, such as a table or desk, the user can carry out single and multi-touch gestures using the space around the device. This gives a larger input space than would otherwise be possible which may be used in conjunction with or instead of on-display touch input. Following a detailed description of our prototype, we discuss some of the interactions it affords.

Supplementary Material

JPG File (p201-butler.jpg)
WMV File (p201-butler.wmv)

References

[1]
Arnaut, L. Y. & Greenstein, J. S. Human Factors Considerations in the Design and Selection of Computer Input Devices. In Sol Sherr (Ed.), Input Devices. Boston: Academic Press, 73--74. 1988.
[2]
Hinckley, K., Pierce, J., Sinclair, M., Horvitz, E., Sensing Techniques for Mobile Interaction, In Proceedings of UIST 2000, CHI Letters 2 (2), pp. 91--100 .
[3]
Hodges, S., Izadi, S., Butler, A., Rrustemi, A., Buxton, B, ThinSight: Versatile Multitouch Sensing For Thin Form Factor Displays, In Proceedings of UIST 2007.
[4]
Hollemans, G. et al., Entertaible: Multi-user multi-object concurrent input, UIST '06 Adjunct Proceedings.
[5]
LightGlove, http://www.lightglove.com/White%20Paper.htm
[6]
RPO, http://www.rpo.biz/DWT_White_Paper.pdf
[7]
Smith, J., White, T, Dodge, C., Paradiso, J., Gershenfeld, N., Electric Field Sensing For Graphics Interfaces, IEEE Computer Graphics & Applns, May/June 1998.
[8]
Virtual Keyboard, http://www.vkb-support.com/index.php
[9]
Vogel, D. and Baudisch, P., Shift: A Technique for Operating Pen-Based Interfaces Using Touch, In CHI 2007, pp. 657--666.
[10]
Wigdor, D., Forlines, C., Baudisch, P., Barnwell, J., Shen, C., LucidTouch: A See-Through Mobile Device, In Proceedings of UIST '07.

Cited By

View all
  • (2024)Exploiting Physical Referent Features as Input for Multidimensional Data Selection in Augmented RealityACM Transactions on Computer-Human Interaction10.1145/364861331:4(1-40)Online publication date: 19-Sep-2024
  • (2024)KeyStubProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314427:4(1-23)Online publication date: 12-Jan-2024
  • (2024)MAF: Exploring Mobile Acoustic Field for Hand-to-Face Gesture InteractionsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642437(1-20)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. SideSight: multi-"touch" interaction around small devices

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UIST '08: Proceedings of the 21st annual ACM symposium on User interface software and technology
    October 2008
    308 pages
    ISBN:9781595939753
    DOI:10.1145/1449715
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 19 October 2008

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. mobile device interaction
    2. multi-touch
    3. novel hardware
    4. proximity sensing

    Qualifiers

    • Research-article

    Conference

    UIST08

    Acceptance Rates

    Overall Acceptance Rate 561 of 2,567 submissions, 22%

    Upcoming Conference

    UIST '25
    The 38th Annual ACM Symposium on User Interface Software and Technology
    September 28 - October 1, 2025
    Busan , Republic of Korea

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)69
    • Downloads (Last 6 weeks)13
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Exploiting Physical Referent Features as Input for Multidimensional Data Selection in Augmented RealityACM Transactions on Computer-Human Interaction10.1145/364861331:4(1-40)Online publication date: 19-Sep-2024
    • (2024)KeyStubProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314427:4(1-23)Online publication date: 12-Jan-2024
    • (2024)MAF: Exploring Mobile Acoustic Field for Hand-to-Face Gesture InteractionsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642437(1-20)Online publication date: 11-May-2024
    • (2024)PalmSpaceInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103219184:COnline publication date: 1-Apr-2024
    • (2023)Human-to-Computer Interactivity Features Incorporated Into Behavioral Health mHealth Apps: Systematic SearchJMIR Formative Research10.2196/449267(e44926)Online publication date: 30-Jun-2023
    • (2023)Form to Flow: Exploring Challenges and Roles of Conversational UX Designers in Real-world, Multi-channel Service EnvironmentsProceedings of the ACM on Human-Computer Interaction10.1145/36101897:CSCW2(1-24)Online publication date: 4-Oct-2023
    • (2023)Acoustic+Pose: Adding Input Modality to Smartphones with Near-Surface Hand-Pose Recognition using Acoustic SurfaceProceedings of the 2023 International Symposium on Wearable Computers10.1145/3594738.3611362(44-49)Online publication date: 8-Oct-2023
    • (2023)Ether-Mark: An Off-Screen Marking Menu For Mobile DevicesProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3614150(224-233)Online publication date: 9-Oct-2023
    • (2023)Enabling Voice-Accompanying Hand-to-Face Gesture Recognition with Cross-Device SensingProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581008(1-17)Online publication date: 19-Apr-2023
    • (2023)SurfAirs: Surface + Mid-air Input for Large Vertical DisplaysProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580877(1-15)Online publication date: 19-Apr-2023
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media