skip to main content
10.1145/1866029.1866034acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article

PhoneTouch: a technique for direct phone interaction on surfaces

Published: 03 October 2010 Publication History

Abstract

PhoneTouch is a novel technique for integration of mobile phones and interactive surfaces. The technique enables use of phones to select targets on the surface by direct touch, facilitating for instance pick&drop-style transfer of objects between phone and surface. The technique is based on separate detection of phone touch events by the surface, which determines location of the touch, and by the phone, which contributes device identity. The device-level observations are merged based on correlation in time. We describe a proof-of-concept implementation of the technique, using vision for touch detection on the surface (including discrimination of finger versus phone touch) and acceleration features for detection by the phone.

Supplementary Material

JPG File (tn172-schmidt.jpg)
MP4 File (tn172-schmidt.mp4)

References

[1]
}}T. Cuypers, Y. Francken, C. Vanaken, F. Van Reeth, and P. Bekaert. Smartphone localization on interactive surfaces using the built-in camera. In Proc. Procams, 2009.
[2]
}}J. Y. Han. Low-cost multi-touch sensing through frustrated total internal reflection. In Proc. UIST, pages 115--118, 2005.
[3]
}}R. Hardy and E. Rukzio. Touch & Interact: Touch-based interaction of mobile phones with displays. In Proc. MobileHCI, pages 245--254, 2008.
[4]
}}K. Hinckley. Synchronous gestures for multiple users and computers. In Proc. UIST, pages 149--158, 2003.
[5]
}}L. Holmquist, F. Mattern, B. Schiele, P. Alahuhta, M. Beigl, and H. Gellersen. Smart-Its friends: A technique for users to easily establish connections between smart artefacts. In Proc. UbiComp, pages 116--122, 2001.
[6]
}}R. Mayrhofer and H. Gellersen. Shake well before use: Intuitive and secure pairing of mobile devices. IEEE Trans. Mob. Comp., 8:792--806, 2009.
[7]
}}D. L. Mills. Internet time synchronization: The network time protocol. IEEE Trans. Comm., 39:1482--1493, 1991.
[8]
}}J. Rekimoto. Pick-and-Drop: A direct manipulation technique for multiple computer environments. In Proc. UIST, pages 31--39, 1997.
[9]
}}J. Rekimoto. SyncTap: Synchronous user operation for spontaneous network connection. Personal and Ubiquitous Computing, 8:126--134, 2004.
[10]
}}S. Ronkainen, J. Häkkilä, S. Kaleva, A. Colley, and J. Linjama. Tap input as an embedded interaction method for mobile devices. In Proc. TEI, pages 263--270, 2007.
[11]
}}M. Strohbach, G. Kortuem, H. Gellersen, and C. Kray. Using cooperative artefacts as basis for activity recognition. In Proc. EUSAI, pages 49--60, 2004.
[12]
}}A. D. Wilson and R. Sarin. BlueTable: Connecting wireless mobile devices on interactive surfaces using vision-based handshaking. In Proc. GI, pages 119--125, 2007.

Cited By

View all
  • (2024)NearFetch: Enhancing Touch-Based Mobile Interaction on Public Displays with an Embedded Programmable NFC ArrayProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685749(234-243)Online publication date: 4-Nov-2024
  • (2023)AdHocProx: Sensing Mobile, Ad-Hoc Collaborative Device Formations using Dual Ultra-Wideband RadiosProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581300(1-18)Online publication date: 19-Apr-2023
  • (2023)SurfAirs: Surface + Mid-air Input for Large Vertical DisplaysProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580877(1-15)Online publication date: 19-Apr-2023
  • Show More Cited By

Index Terms

  1. PhoneTouch: a technique for direct phone interaction on surfaces

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technology
    October 2010
    476 pages
    ISBN:9781450302715
    DOI:10.1145/1866029
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 03 October 2010

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. interaction techniques
    2. interactive tabletops
    3. mobile phones
    4. personal devices
    5. surface computing

    Qualifiers

    • Research-article

    Conference

    UIST '10

    Acceptance Rates

    Overall Acceptance Rate 561 of 2,567 submissions, 22%

    Upcoming Conference

    UIST '25
    The 38th Annual ACM Symposium on User Interface Software and Technology
    September 28 - October 1, 2025
    Busan , Republic of Korea

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)33
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 07 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)NearFetch: Enhancing Touch-Based Mobile Interaction on Public Displays with an Embedded Programmable NFC ArrayProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685749(234-243)Online publication date: 4-Nov-2024
    • (2023)AdHocProx: Sensing Mobile, Ad-Hoc Collaborative Device Formations using Dual Ultra-Wideband RadiosProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581300(1-18)Online publication date: 19-Apr-2023
    • (2023)SurfAirs: Surface + Mid-air Input for Large Vertical DisplaysProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580877(1-15)Online publication date: 19-Apr-2023
    • (2023)A Study of Zooming, Interactive Lenses and Overview+Detail Techniques in Collaborative Map-based Tasks2023 IEEE 16th Pacific Visualization Symposium (PacificVis)10.1109/PacificVis56936.2023.00009(11-20)Online publication date: Apr-2023
    • (2022)AcousticType: Smartwatch-Enabled Cross-Device Text Entry Method Using Keyboard AcousticsExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519691(1-7)Online publication date: 27-Apr-2022
    • (2020)Motion Coupling of Earable Devices in Camera ViewProceedings of the 19th International Conference on Mobile and Ubiquitous Multimedia10.1145/3428361.3428470(13-17)Online publication date: 22-Nov-2020
    • (2019)SMACProceedings of the ACM on Human-Computer Interaction10.1145/33009613:EICS(1-47)Online publication date: 13-Jun-2019
    • (2019)Cross-Device TaxonomyProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300792(1-28)Online publication date: 2-May-2019
    • (2019)Combining Tablets with Smartphones for Data AnalyticsHuman-Computer Interaction – INTERACT 201910.1007/978-3-030-29390-1_24(439-460)Online publication date: 2-Sep-2019
    • (2018)Tap-to-PairProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/32870792:4(1-21)Online publication date: 27-Dec-2018
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media