Hand distinction for multi-touch tabletop interaction

ABSTRACT

Recent multi-touch multi-user tabletop systems offer rich touch contact properties to applications. Not only they provide touch positions, but also finger orientations. Applications can use these properties separated for each finger or derive information by combining the given touch contact data. In this paper, we present an approach to map fingers to their associated joined hand contributing to potential enhancements for gesture recognition and user interaction. For instance, a gesture can be composed of multiple fingers of one hand or different hands. Therefore, we present a simple heuristic for mapping fingers to hands that makes use of constraints applied to the touch position combined with the finger orientation. We tested our approach with collected diverse touch contact data and analyze the results.

References

1. Nui group community, getting started with multitouch - multitouch techniques. http://nuigroup.com/forums/viewthread/1982.
2. Touchlib, a multi-touch development kit. http://www.nuigroup.com/touchlib.
3. P.-A. Albinsson and S. Zhai. High precision touch screen interaction. In CHI '03: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 105--112. ACM, 2003.
4. H. Benko, A. D. Wilson, and P. Baudisch. Precise selection techniques for multi-touch screens. In CHI '06: Proceedings of the SIGCHI conference on Human Factors in computing systems, pages 1263--1272. ACM, 2006.
5. P. Dietz and D. Leigh. Diamondtouch: a multi-user touch technology. In UIST '01: Proceedings of the 14th annual ACM symposium on User interface software and technology, pages 219--226. ACM, 2001.
6. S. Do-Lenh, F. Kaplan, A. Sharma, and P. Dillenbourg. Multi-finger interactions with papers on augmented tabletops. In TEI '09: Proceedings of the 3rd International Conference on Tangible and Embedded Interaction, pages 267--274. ACM, 2009.
7. K. C. Dohse, T. Dohse, J. D. Still, and D. J. Parkhurst. Enhancing multi-user interaction with multi-touch tabletop displays using hand tracking. In ACHI '08: Proceedings of the First International Conference on Advances in Computer-Human Interaction, pages 297--302. IEEE Computer Society, 2008.
8. F. Echtler, M. Huber, and G. Klinker. Shadow tracking on multi-touch tables. In AVI '08: Proceedings of the working conference on Advanced visual interfaces, pages 388--391. ACM, 2008.
9. F. Echtler and G. Klinker. A multitouch software architecture. In NordiCHI '08: Proceedings of the 5th Nordic conference on Human-computer interaction, pages 463--466. ACM, 2008.
10. J. Epps, S. Lichman, and M. Wu. A study of hand shape use in tabletop gesture interaction. In CHI '06: CHI '06 extended abstracts on Human factors in computing systems, pages 748--753. ACM, 2006.
11. C. Forlines, D. Wigdor, C. Shen, and R. Balakrishnan. Direct-touch vs. mouse input for tabletop displays. In CHI '07: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 647--656. ACM, 2007.
12. J. Y. Han. Low-cost multi-touch sensing through frustrated total internal reflection. In UIST '05: Proceedings of the 18th annual ACM symposium on User interface software and technology, pages 115--118. ACM, 2005.
13. W. A. König, J. Gerken, S. Dierdorf, and H. Reiterer. Adaptive pointing: implicit gain adaptation for absolute pointing devices. In CHI EA '09: Proceedings of the 27th international conference extended abstracts on Human factors in computing systems, pages 4171--4176. ACM, 2009.
14. R. Kruger, S. Carpendale, S. D. Scott, and A. Tang. Fluid integration of rotation and translation. In CHI '05: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 601--610. ACM, 2005.
15. S. Malik and J. Laszlo. Visual touchpad: a two-handed gestural input device. In ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces, pages 289--296. ACM, 2004.
16. E. Mansor, A. De Angeli, and O. De Bruijn. Little fingers on the tabletop: A usability evaluation in the kindergarten. In Horizontal Interactive Human Computer Systems, 2008. TABLETOP 2008. 3rd IEEE International Workshop on, pages 93--96, 2008.
17. J. Matejka, T. Grossman, J. Lo, and G. Fitzmaurice. The design and evaluation of multi-finger mouse emulation techniques. In CHI '09: Proceedings of the 27th international conference on Human factors in computing systems, pages 1073--1082. ACM, 2009.
18. T. Moscovich and J. F. Hughes. Indirect mappings of multi-touch input using one and two hands. In CHI '08: Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, pages 1275--1284. ACM, 2008.
19. P. Peltonen, E. Kurvinen, A. Salovaara, G. Jacucci, T. Ilmonen, J. Evans, A. Oulasvirta, and P. Saarikko. It's mine, don't touch!: interactions at a large multi-touch display in a city centre. In CHI '08: Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, pages 1285--1294. ACM, 2008.
20. C. Sousa and M. Matsumoto. Study on fluent interaction with multi-touch in traditional gui environments. In TENCON 2007, pages 1--4, 2007.
21. L. Terrenghi, D. Kirk, A. Sellen, and S. Izadi. Affordances for manipulation of physical versus digital media on interactive surfaces. In CHI '07: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 1157--1166. ACM, 2007.
22. E. Tse, C. Shen, S. Greenberg, and C. Forlines. Enabling interaction with single user applications through speech and gestures on a multi-user tabletop. In AVI '06: Proceedings of the working conference on Advanced visual interfaces, pages 336--343. ACM, 2006.
23. D. Vogel and P. Baudisch. Shift: A technique for operating pen-based interfaces using touch. In CHI '07: Proceedings of the conference on Human factors in computing systems, pages 657--666. ACM, 2007.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision tasks

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Touch screens