skip to main content
10.1145/1842993.1843040acmotherconferencesArticle/Chapter ViewAbstractPublication PagesaviConference Proceedingsconference-collections
research-article

Pac-pac: pinching gesture recognition for tabletop entertainment system

Published: 26 May 2010 Publication History

Abstract

We present our new interaction technique for tabletop system and video game application using it. This technique is for recognizing a pinching gesture performed with the thumb and forefinger and tapping gestures with them by a ceiling camera above the table. The positions and orientations of multiple gestures are recognized at 200Hz, and the users around the table are tracked by their arm positions. This technique is useful for large-sized tabletop system for multiple users because it does not require any additional equipments to them nor registration process before using the system. Some pilot studies demonstrated the robustness and accuracy of the proposed technique with displaying appropriate guide on the display. We also developed a video game application called "Pac-pac". A player can shoot a bullet along the orientation of his hand by tapping, from any side of the table. We exhibited Pac-pac several time and well-received.

References

[1]
X. Cao, A. D. Wilson, R. Balakrishnan, K. Hinckley, and S. E. Hudson. Shapetouch: Leveraging contact shape on interactive surfaces. In Proceedings of the 2008 IEEE International Workshop on Horizontal Interactive Human Computer System (TABLETOP), pages 139--146. IEEE, 2008.
[2]
P. H. Dietz and D. Leigh. Diamondtouch: A multi-user touch technology. In UIST '01: Proceedings of the 14th annual ACM symposium on User interface software and technology, pages 219--226, 2001.
[3]
K. Fukuchi. Concurrent Manipulation of Multiple Components on Graphical User Interface. PhD thesis, Tokyo Institute of Technology, 2006.
[4]
K. Fukuchi and J. Rekimoto. Marble market: Bimanual interactive game with a body shape sensor. In L. Ma, M. Rauterberg, and R. Nakatsu, editors, Entertainment Computing - ICEC2007, volume 4740 of Lecture Notes in Computer Science, pages 374--380. Springer, 2007.
[5]
M. Fukumoto and Y. Tonomura. Whisper: a wristwatch style wearable handset. In CHI '99: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 112--119. ACM, 1999.
[6]
J. Y. Han. Low-cost multi-touch sensing through frustrated total internal reflection. In UIST '05: Proceedings of the 18th annual ACM symposium on User interface software and technology, pages 115--118. ACM Press, 2005.
[7]
G. Hollemans, T. Bergman, V. Buil, K. van Gelder, M. Groten, J. Hoonhout, T. Lashina, E. van Loenen, and S. van de Wijdeven. Entertaible: Multi-user multi-object concurrent input. In Adjunct Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (UIST06), pages 55--56. ACM, 2006.
[8]
H. Mamiya, T. Sato, K. Fukuchi, and H. Koike. A tabletop entertainment system and finger tapping gesture recognition. In Proceedings of WISS 2007, pages 53--58. JSSST, 12 2007. (in Japanese).
[9]
N. Matsushita and J. Rekimoto. Holowall: Designing a finger, hand, body, and object sensitive wall. In UIST '97: Proceedings of the 10th annual ACM symposium on User interface software and technology, pages 209--210, 1997.
[10]
S. Noda, K. Yamamoto, M. Okumura, and I. Akahori. Yubi-nya: the ring detecting a ring by fingers. In Proceedings of INTERACTION 2009, pages 135--136, 2009. (in Japanese).
[11]
J. Rekimoto. Smartskin: An infrastructure for freehand manipulation on interactive surfaces. In Proceedings of CHI2002, pages 113--120, 2002.
[12]
T. Sato, K. Fukuchi, and H. Koike. Implementation and evaluations of vision-based finger flicking gesture recognition for tabletops. In Proceedings of the 2008 IEEE International Workshop on Horizontal Interactive Human Computer System (TABLETOP), pages 147--154. IEEE, 2008.
[13]
T. Sato, H. Mamiya, H. Koike, and K. Fukuchi. An augmented tabletop video game with pinching gesture recognition. In The 1st ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive TEchniques in Asia (SIGGRAPH Asia 2008): Art Gallery & Emerging Technologies. ACM, 2008.
[14]
Y. Sato, Y. Kobayashi, and H. Koike. Fast tracking of hands and fingertips in infrared images for augmented desk interface. In Proceedings of IEEE Automatic Face and Gesture Recognition, pages 462--467, 2000.
[15]
W. Westerman. Hand Tracking, Finger Identification and Chordic Manipulation on a Multi-Touch Surface. PhD thesis, University of Delaware, 1999.
[16]
A. Wilson. Robust computer vision-based detection of pinching for one and two-handed gesture input. In UIST '06: Proceedings of the 19th annual ACM symposium on User interface software and technology, pages 255--258. ACM, ACM Press, 2006.
[17]
T. G. Zimmerman, J. Lanier, C. Blanchard, S. Bryson, and Y. Harvill. A hand gesture interface device. SIGCHI Bulletin, 17(SI):189--192, 1987.

Cited By

View all
  • (2022)Scenario-based Exploration of Integrating Radar Sensing into Everyday Objects for Free-Hand Television ControlProceedings of the 2022 ACM International Conference on Interactive Media Experiences10.1145/3505284.3532982(357-362)Online publication date: 21-Jun-2022
  • (2021)Comparative Study of Gesture Recognition Based on Accelerometer and Photoplethysmography Sensor for Gesture Interactions in Wearable DevicesIEEE Sensors Journal10.1109/JSEN.2021.308171421:15(17107-17117)Online publication date: 1-Aug-2021
  • (2018)User Study of Floor Interaction with Wearable Projection Interface Using Hand and Toeウェアラブル手足入力インタフェースの有用性の調査Transactions of the Institute of Systems, Control and Information Engineers10.5687/iscie.31.11231:3(112-120)Online publication date: 15-Mar-2018
  • Show More Cited By

Index Terms

  1. Pac-pac: pinching gesture recognition for tabletop entertainment system

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    AVI '10: Proceedings of the International Conference on Advanced Visual Interfaces
    May 2010
    427 pages
    ISBN:9781450300766
    DOI:10.1145/1842993
    • Editor:
    • Giuseppe Santucci
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    • Consulta Umbria SRL

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 26 May 2010

    Permissions

    Request permissions for this article.

    Check for updates

    Qualifiers

    • Research-article

    Conference

    AVI '10
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 128 of 490 submissions, 26%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)5
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 15 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2022)Scenario-based Exploration of Integrating Radar Sensing into Everyday Objects for Free-Hand Television ControlProceedings of the 2022 ACM International Conference on Interactive Media Experiences10.1145/3505284.3532982(357-362)Online publication date: 21-Jun-2022
    • (2021)Comparative Study of Gesture Recognition Based on Accelerometer and Photoplethysmography Sensor for Gesture Interactions in Wearable DevicesIEEE Sensors Journal10.1109/JSEN.2021.308171421:15(17107-17117)Online publication date: 1-Aug-2021
    • (2018)User Study of Floor Interaction with Wearable Projection Interface Using Hand and Toeウェアラブル手足入力インタフェースの有用性の調査Transactions of the Institute of Systems, Control and Information Engineers10.5687/iscie.31.11231:3(112-120)Online publication date: 15-Mar-2018
    • (2018)A real-time image processing framework with an aerial overhead camera for sportsProceedings of the 2018 International Conference on Advanced Visual Interfaces10.1145/3206505.3206520(1-5)Online publication date: 29-May-2018
    • (2017)Three-Dimensional Input System Employing Pinching Gestures for Robot DesignInternational Journal of Automation Technology10.20965/ijat.2017.p037811:3(378-384)Online publication date: 28-Apr-2017
    • (2016)Can Eye Help You?Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems10.1145/2858036.2858438(5180-5190)Online publication date: 7-May-2016
    • (2016)A Remote Pointing Method with Dynamic C-D Ratio during a Pinching Gesture for Large Tabletop SystemsProceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems10.1145/2851581.2892579(553-559)Online publication date: 7-May-2016
    • (2016)Hand Gesture Interface for Entertainment GamesHandbook of Digital Games and Entertainment Technologies10.1007/978-981-4560-50-4_47(293-312)Online publication date: 10-Aug-2016
    • (2016)Floor Interaction with Wearable Projection Interface Using Hand and ToeCollaboration Technologies and Social Computing10.1007/978-981-10-2618-8_9(105-116)Online publication date: 3-Sep-2016
    • (2015)Hand Gesture Interface for Entertainment GamesHandbook of Digital Games and Entertainment Technologies10.1007/978-981-4560-52-8_47-1(1-20)Online publication date: 7-Oct-2015
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media