Shadow tracking on multi-touch tables

ABSTRACT

Multi-touch interfaces have been a focus of research in recent years, resulting in development of various innovative UI concepts. Support for existing WIMP interfaces, however, should not be overlooked. Although several approaches exist, there is still room for improvement, particularly regarding implementation of the "hover" state, commonly used in mouse-based interfaces.

In this paper, we present a multi-touch system which is designed to address this problem. A multi-touch table based on FTIR (frustrated total internal reflection) is extended with a ceiling-mounted light source to create shadows of hands and arms. By tracking these shadows with the rear-mounted camera which is already present in the FTIR setup, users can control multiple cursors without touching the table and trigger a "click" event by tapping the surface with any finger of the corresponding hand.

An informal evaluation with 15 subjects found an improvement in accuracy when compared to an unaugmented touch screen.

References

1. Smart Technologies. SMART Board. http://www.smarttech.com/Smart Board.
2. F. Echtler. Shadow tracking demonstration video. http://campar.in.tum.de/personal/echtler/avi08--shadowtrack.avi.
3. P. Dietz and D. Leigh. DiamondTouch: a multi-user touch technology. In UIST '01: Proceedings of the 14th annual ACM symposium on User interface software and technology, pages 219--226, New York, NY, USA, 2001. ACM Press.
4. R. I. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, second edition, 2004.
5. S. Malik and J. Laszlo. Visual touchpad: a two-handed gestural input device. In ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces, pages 289--296, New York, NY, USA, 2004. ACM Press.
6. A. Wilson. PlayAnywhere: a compact interactive tabletop projection-vision system. In UIST '05: Proceedings of the 18th annual ACM symposium on User interface software and technology, pages 83--92, 2005.
7. J. Han. Low-cost multi-touch sensing through frustrated total internal reflection. In UIST '05: Proceedings of the 18th annual ACM symposium on User interface software and technology, pages 115--118, New York, NY, USA, 2005. ACM Press.
8. W. Buxton, R. Hill, and P. Rowley. Issues and techniques in touch-sensitive tablet input. In SIGGRAPH '85: Proceedings of the 12th annual conference on Computer graphics and interactive techniques, pages 215--224, New York, NY, USA, 1985. ACM.
9. A. Esenther and K. Ryall. Fluid DTMouse: better mouse support for touch-based interactions. In AVI '06: Proceedings of the working conference on Advanced visual interfaces, pages 112--115, New York, NY, USA, 2006. ACM Press.
10. A. Wilson. TouchLight: an imaging touch screen and display for gesture-based interaction. In ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces, pages 69--76, New York, NY, USA, 2004. ACM Press.
11. H. Benko, A. Wilson, and P. Baudisch. Precise selection techniques for multi-touch screens. In CHI '06: Proceedings of the SIGCHI conference on Human Factors in computing systems, pages 1263--1272, New York, NY, USA, 2006. ACM Press.
12. J. Rekimoto. SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. In CHI '02: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 113--120, New York, NY, USA, 2002. ACM Press.
13. H. Ishii and B. Ullmer. Tangible bits: Towards seamless interfaces between people, bits and atoms. In CHI '97: Proceedings of the Conference on Human Factors in Computing Systems, pages 234--241, 1997.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Touch screens