skip to main content
10.1145/1294211.1294258acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
Article

ThinSight: versatile multi-touch sensing for thin form-factor displays

Published: 07 October 2007 Publication History

Abstract

ThinSight is a novel optical sensing system, fully integrated into a thin form factor display, capable of detecting multi-ple fingers placed on or near the display surface. We describe this new hardware in detail, and demonstrate how it can be embedded behind a regular LCD, allowing sensing without degradation of display capability. With our approach, fingertips and hands are clearly identifiable through the display. The approach of optical sensing also opens up the exciting possibility for detecting other physical objects and visual markers through the display, and some initial experiments are described. We also discuss other novel capabilities of our system: interaction at a distance using IR pointing devices, and IR-based communication with other electronic devices through the display. A major advantage of ThinSight over existing camera and projector based optical systems is its compact, thin form-factor making such systems even more deployable. We therefore envisage using ThinSight to capture rich sensor data through the display which can be processed using computer vision techniques to enable both multi-touch and tangible interaction.

References

[1]
Apple iPhone Multi-touch. http://www.apple.com/iphone/technology/
[2]
L. Bürgi et al., 2006. Optical proximity and touch sen--sors based on monolithically integrated polymer pho-todiodes and polymer LEDs. In Organic Electronics 7.
[3]
Bill Buxton, 2007. Multi-Touch Systems that I Have Known and Loved. http://www.billbuxton.com/multitouchOverview.html
[4]
Paul Dietz and Darren Leigh. DiamondTouch: a multi-user touch technology. In ACM UIST 2001.
[5]
P.H. Dietz et al. DT Controls: Adding Identity to Physical Interfaces. In ACM UIST 2005.
[6]
J. Y. Han, 2005. Low-Cost Multi-Touch Sensing through Frustrated Total Internal Reflection. In ACM UIST 2005.
[7]
Jeff Han. Multi-Touch Sensing through LED Matrix Displays. http://cs.nyu.edu/~jhan/ledtouch/index.html
[8]
Scott Hudson, 2004. Using Light Emitting Diode Ar-rays as Touch-Sensitive Input and Output Devices. In ACM UIST 2004.
[9]
JazzMutant Lemur. http://www.jazzmutant.com/lemur_overview.php.
[10]
Sergi Jordà, Martin Kaltenbrunner, Günter Geiger, Ross Bencina, 2005. The reacTable. International Computer Music Conference (ICMC2005), 2005.
[11]
Myron W. Krueger, Thomas Gionfriddo, and Katrin Hinrichsen. Videoplace: an artificial reality. In ACM CHI 1985, 35--40.
[12]
S.K. Lee, W. Buxton, K.C. Smith, A Multi-Touch 3D Touch-Sensitive Tablet. In ACM CHI 1985.
[13]
Evert van Loenen et al. Entertaible: A Solution for Social Gaming Experiences. In Tangible Play workshop, IUI Conference, 2007.
[14]
Shahzad Malik and Joe Laszlo, 2004. Visual Touchpad: A Two-handed Gestural Input Device. In Conference on Multimodal Interfaces 2004.
[15]
Nobuyuki Matsushita and Jun Rekimoto, 1997. HoloWall: designing a finger, hand, body, and object sensitive wall. In ACM UIST 1997.
[16]
Nobuyuki Matsushita, Yuji Ayatsuka and Jun Rekimoto, 2000. Dual touch: a two-handed interface for pen-based PDAs. In ACM UIST 2000.
[17]
Microsoft Surface, http://www.surface.com
[18]
Nintendo Wii, http://www.wii.com
[19]
J. Dan R. Olsen and T. Nielsen. Laser pointer interaction. In ACM CHI 2001, 17--22.
[20]
Rekimoto, J., SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. In ACM CHI 2002, 113--120.
[21]
Tactex Controls Inc. Array Sensors. http://www.tactex.com/products_array.php
[22]
Toshiba Matsushita, LCD with Finger Shadow Sensing, http://www3.toshiba.co.jp/tm_dsp/press/2005/05-09-29.htm
[23]
Wayne Westerman, 1999. Hand Tracking, Finger Identification and Chordic Manipulation on a Multi-Touch Surface. PhD thesis, University of Delaware.
[24]
Pierre Wellner, 1993. Interacting with Paper on the Digital Desk. CACM 36(7): 86--96.
[25]
Andrew D. Wilson, 2004. TouchLight: An Imaging Touch Screen and Display for Gesture-Based Interaction. In Conference on Multimodal Interfaces 2004.
[26]
Andrew D. Wilson, 2005. PlayAnywhere: A Compact Interactive Tabletop Projection-Vision System. In ACM UIST 2005.
[27]
Mike Wu and Ravin Balakrishnan, 2003. Multi-finger and Whole Hand Gestural Interaction Techniques for Multi-User Tabletop Displays. In ACM UIST 2003.

Cited By

View all
  • (2024)RFTIRTouch: Touch Sensing Device for Dual-sided Transparent Plane Based on Repropagated Frustrated Total Internal ReflectionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676428(1-10)Online publication date: 13-Oct-2024
  • (2024)OptoSkin: Novel LIDAR Touch Sensors for Detection of Touch and Pressure Within Wave GuidesIEEE Sensors Journal10.1109/JSEN.2024.344361524:20(33268-33280)Online publication date: 15-Oct-2024
  • (2020)OptoSenseProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34118264:3(1-27)Online publication date: 4-Sep-2020
  • Show More Cited By

Index Terms

  1. ThinSight: versatile multi-touch sensing for thin form-factor displays

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UIST '07: Proceedings of the 20th annual ACM symposium on User interface software and technology
    October 2007
    306 pages
    ISBN:9781595936790
    DOI:10.1145/1294211
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 07 October 2007

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. infrared sensing
    2. multi-touch
    3. novel hardware
    4. physical objects
    5. thin form-factor displays

    Qualifiers

    • Article

    Conference

    UIST07

    Acceptance Rates

    Overall Acceptance Rate 561 of 2,567 submissions, 22%

    Upcoming Conference

    UIST '25
    The 38th Annual ACM Symposium on User Interface Software and Technology
    September 28 - October 1, 2025
    Busan , Republic of Korea

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)43
    • Downloads (Last 6 weeks)9
    Reflects downloads up to 14 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)RFTIRTouch: Touch Sensing Device for Dual-sided Transparent Plane Based on Repropagated Frustrated Total Internal ReflectionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676428(1-10)Online publication date: 13-Oct-2024
    • (2024)OptoSkin: Novel LIDAR Touch Sensors for Detection of Touch and Pressure Within Wave GuidesIEEE Sensors Journal10.1109/JSEN.2024.344361524:20(33268-33280)Online publication date: 15-Oct-2024
    • (2020)OptoSenseProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34118264:3(1-27)Online publication date: 4-Sep-2020
    • (2020)WATouCH: Enabling Direct Input on Non-touchscreen Using Smartwatch's Photoplethysmogram and IMU Sensor FusionProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376198(1-10)Online publication date: 21-Apr-2020
    • (2019)RFTouchPadsProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332165.3347910(999-1011)Online publication date: 17-Oct-2019
    • (2018)Self-Powered Gesture Recognition with Ambient LightProceedings of the 31st Annual ACM Symposium on User Interface Software and Technology10.1145/3242587.3242635(595-608)Online publication date: 11-Oct-2018
    • (2017)Investigating pre-touch for sound generation on multi-touch surfaces using blob area detection2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC.2017.8122752(1064-1068)Online publication date: Oct-2017
    • (2016)EnhancedTouchProceedings of the 2016 CHI Conference on Human Factors in Computing Systems10.1145/2858036.2858439(1282-1293)Online publication date: 7-May-2016
    • (2016)MonoTouchProceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems10.1145/2851581.2892350(2736-2743)Online publication date: 7-May-2016
    • (2015)Joint 5D Pen Input for Light Field DisplaysProceedings of the 28th Annual ACM Symposium on User Interface Software & Technology10.1145/2807442.2807477(637-647)Online publication date: 5-Nov-2015
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media