skip to main content
10.1145/1517664.1517720acmotherconferencesArticle/Chapter ViewAbstractPublication PagesteiConference Proceedingsconference-collections
research-article

Multi-finger interactions with papers on augmented tabletops

Published: 16 February 2009 Publication History

Abstract

Although many augmented tabletop systems have shown the potential and usability of finger-based interactions and paper-based interfaces, they have mainly dealt with each of them separately. In this paper, we introduce a novel method aimed to improve human natural interactions on augmented tabletop systems, which enables multiple users to use both fingertips and physical papers as mediums for interaction. This method uses computer vision techniques to detect multi-fingertips both over and touching the surface in real-time regardless of their orientations. Fingertip and touch positions would then be used in combination with paper tracking to provide a richer set of interaction gestures that the users can perform in collaborative scenarios.

References

[1]
Signer Beat and C. Norrie Moira. Paperpoint: a paper-based presentation and interactive paper prototyping tool. Proceedings of the International Conference on Tangible and Embedded Interaction, pages 57--64, 2007.
[2]
P. Brandl, M. Haller, J. Oberngruber, and C. Schafleitner. Bridging the gap between real printouts and digital whiteboard. Proceedings of the conference on Advanced Visual Interfaces AVI'08, 2008.
[3]
Holman David, Vertegaal Roel, Altosaar Mark, Troje Nikolaus, and Johns Derek. Paper windows: interaction techniques for digital paper. Proceedings of CHI'05, pages 591--599, 2005.
[4]
P. H. Dietz and D. L. Leigh. Diamondtouch: A multi-user touch technology. ACM Symposium on User Interface Software and Technology (UIST'01), pages 219--226, 2001.
[5]
Mark Fiala. ARTag, a fiducial marker system using digital techniques. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'05), pages 590--596, 2005.
[6]
M. Fjeld, K. Lauche, M. Bichsel, F. Voorhorst, H. Krueger, and M. Rauterberg. Physical and virtual tools: Activity theory applied to the design of groupware. In B. A. Nardi and D. F. Redmiles (eds.) A Special Issue of CSCW: Activity Theory and the Practice of Design, volume 11(1--2), pages 153--180, 2002.
[7]
Jefferson Y. Han. Low-cost multi-touch sensing through frustrated total internal reflection. ACM symposium on User interface software and technology, pages 115--118, 2005.
[8]
Scott R. Klemmer, Mark W. Newman, Ryan Farrell, Mark Bilezikjian, and James A. Landay. The designers' outpost: a tangible interface for collaborative web site. ACM symposium on User interface software and technology (UIST'01), pages 1--10, 2001.
[9]
H. Koike, Y. Sato, Y. Kobayashi, H. Tobita, and M. Kobayashi. Interactive textbook and interactive venn diagram: natural and intuitive interfaces on augmented desk system. in CHI '00, pages 121--128, 2000.
[10]
J. Kovac, P. Peer, and F. Solina. Human skin color clustering for face detection. EUROCON 2003. Computer as a Tool. The IEEE Region 8, 2:144--148, 2003.
[11]
Nelson Les, Ichimura Satoshi, Ronby Pedersen Elin, and Adams Lia. Palette: a paper interface for giving presentations. Proceedings of the SIGCHI conference on Human factors in Computing Systems, 1999.
[12]
J. Letessier and F. Berard. Visual tracking of bare fingers for interactive surfaces. ACM Symposium on User interface Software and Technology (UIST '04), pages 119--122, 2004.
[13]
Chunyuan Liao, François Guimbretière, Ken Hinckley, and Jim Hollan. Papiercraft: A gesture-based command system for interactive paper. ACM Trans. Comput.-Hum. Interact., 14(4):1--27, 2008.
[14]
W. Mackay, G. Pothier, C. Letondal, K. Boegh, and H. Erik Sorensen. The missing link: augmenting biology laboratory notebooks. In ACM symposium on User interface software and technology (UIST'02), pages 41--50, 2002.
[15]
S. Malik and J. Laszlo. Visual touchpad: A two-handed gestural input device. In Proceedings of the 6th International Conference on Multimodal Interfaces, ICMI 04, pages 289--296, 2004.
[16]
C. McDonald, G. Roth, and S. Marsh. Red-handed: collaborative gesture interaction with a projection table. International Conference on Automatic Face and Gesture Recognition, FG2004., pages 773--778, 2004.
[17]
N. Otsu. A threshold selection method from gray-level histograms. Systems, Man and Cybernetics, IEEE Transactions on, 9(1):62--66, Jan. 1979.
[18]
J. Rekimoto. Smartskin: an infrastructure for freehand manipulation on interactive surfaces. SIGCHI Conference on Human Factors in Computing Systems (CHI'02), pages 113--120, 2002.
[19]
Lisa Stifelman, Barry Arons, and Chris Schmandt. The audio notebook: paper and pen interaction with structured speech. In CHI '01: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 182--189, 2001.
[20]
Carlo Tomasi, Abbas Rafii, and Ilhami Torunoglu. Full-size projection keyboard for handheld devices. Communications of the ACM, 46(7):70--75, 2003.
[21]
B. Ullmer and H. Ishii. The metadesk: models and prototypes for tangible user interfaces. ACM Symposium on User interface Software and Technology, (UIST97), pages 223--232, 1997.
[22]
Pierre Wellner. Interacting with paper on the digital desk. Communications of the ACM, 36(7):87--96, 1993.
[23]
A. Wilson. Touchlight: An imaging touch screen and display for gesture-based interaction. In Proceedings of the 6th International Conference on Multimodal Interfaces, ICMI 04, pages 69--76, 2004.
[24]
Andrew Wilson. Playanywhere: a compact interactive tabletop projection-vision system. ACM symposium on User interface software and technology, pages 83--92, 2005.
[25]
Chih-Sung Wu, Susan J. Robinson, and Ali Mazalek. Turning a page on the digital annotation of physical books. In Proceedings of TEI '08, pages 109--116, 2008.
[26]
Ron Yeh, Andreas Paepcke, and Scott Klemmer. Iterative design and evaluation of an event architecture for pen-and-paper interfaces. 2008.
[27]
Z. Zhang, Y. Wu, Y. Shan, and S. Shafer. Visual panel: virtual mouse, keyboard and 3d controller with an ordinary piece of paper. In PUI '01: Workshop on Perceptive user interfaces, pages 1--8, 2001.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
TEI '09: Proceedings of the 3rd International Conference on Tangible and Embedded Interaction
February 2009
407 pages
ISBN:9781605584935
DOI:10.1145/1517664
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • Microsoft Research (USA)
  • Microsoft Research Cambridge (UK)
  • Nokia (Finland)
  • Microsoft Hardware (USA)

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 February 2009

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article

Conference

TEI09
Sponsor:

Acceptance Rates

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)6
  • Downloads (Last 6 weeks)0
Reflects downloads up to 22 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2021)Hybrid Paper-Digital Interfaces: A Systematic Literature ReviewProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462059(1087-1100)Online publication date: 28-Jun-2021
  • (2017)User interface based on natural interaction design for seniorsComputers in Human Behavior10.1016/j.chb.2017.05.01175:C(147-159)Online publication date: 1-Oct-2017
  • (2016)Space BoardsInternational Journal of Creative Interfaces and Computer Graphics10.4018/IJCICG.20160101037:1(40-56)Online publication date: 1-Jan-2016
  • (2016)Near-Field Touch Interface Using Time-of-Flight CameraJournal of Robotics and Mechatronics10.20965/jrm.2016.p075928:5(759-775)Online publication date: 20-Oct-2016
  • (2016)Freehand interaction with a paper-based input interfaceInternational Journal of Computer Applications in Technology10.1504/IJCAT.2016.07875954:2(106-120)Online publication date: 1-Jan-2016
  • (2016)Active PathwaysProceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces10.1145/2992154.2992176(129-138)Online publication date: 6-Nov-2016
  • (2015)Sketch-Play-Learn - An Augmented Paper Based Environment for Learning the Concepts of OpticsProceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition10.1145/2757226.2764558(213-216)Online publication date: 22-Jun-2015
  • (2015)Recognition of Written Cues System for Users of General Paper MediaHuman Interface and the Management of Information. Information and Knowledge Design10.1007/978-3-319-20612-7_45(466-476)Online publication date: 21-Jul-2015
  • (2014)HumanTopMultimedia Tools and Applications10.1007/s11042-012-1193-y70:3(1837-1868)Online publication date: 1-Jun-2014
  • (2013)When Paper Meets Multi-touch: A Study of Multi-modal Interactions in Air Traffic ControlHuman-Computer Interaction – INTERACT 201310.1007/978-3-642-40477-1_12(196-213)Online publication date: 2013
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media