Adoiraccourcix: multi-touch command selection using finger identification

ABSTRACT

Hotkeys are a critical factor of performance for expert users in WIMP interfaces. Multi-touch interfaces, by contrast, do not provide such efficient command shortcuts. We propose Adoiraccourcix, which leverage finger identification to introduce quick command invocation integrated with direct manipulation in this context. After presenting the concept behind, we illustrated Adoiraccourcix in a vectorial drawing application and ran preliminary user studies comparing Adoiraccourcix to classical user interfaces. Results suggest that once mastered, Adoiraccourcix provides very powerful means of interaction.

References

1. Au, O. K.-C., and Tai, C.-L. Multitouch finger registration and its applications. In Proc. OZCHI'10, 41--48.
2. Bailly, G., Lecolinet, E., and Guiard, Y. Finger-count & radial-stroke shortcuts: 2 techniques for augmenting linear menus on multi-touch surfaces. In Proc. CHI'10, 591--594.
3. Bailly, G., Pietrzak, T., Deber, J., and Wigdor, D. J. Métamorphe: augmenting hotkey usage with actuated keys. In Proc. CHI'13, 563--572.
4. Benko, H., Saponas, T. S., Morris, D., and Tan, D. Enhancing input on and above the interactive surface with muscle sensing. In Proc. ITS'09, 93--100.
5. Bier, E. A., Stone, M. C., Pier, K., Buxton, W., and DeRose, T. D. Toolglass and magic lenses: the see-through interface. In Proc. SIGGRAPH'93, 73--80.
6. Cao, X., Wilson, A., Balakrishnan, R., Hinckley, K., and Hudson, S. Shapetouch: Leveraging contact shape on interactive surfaces. In Proc. TABLETOP'08, 129--136.
7. Davidson, P. L., and Han, J. Y. Extending 2d object arrangement with pressure-sensitive layering cues. In Proc. UIST'08, 87--90.
8. Ghomi, E., Huot, S., Bau, O., Beaudouin-Lafon, M., and Mackay, W. E. Arpège: Learning multitouch chord gestures vocabularies. In Proc. ITS'13, 209--218.
9. Grossman, T., Dragicevic, P., and Balakrishnan, R. Strategies for accelerating on-line learning of hotkeys. In Proc. CHI'07, 1591--1600.
10. Guimbretière, F., Martin, A., and Winograd, T. Benefits of merging command selection and direct manipulation. ACM ToCHI 12, 3 (Sept. 2005), 460--476.
11. Harrison, C., Schwarz, J., and Hudson, S. E. TapSense: enhancing finger interaction on touch surfaces. In Proc. UIST'11, 627--636.
12. Hinckley, K., Yatani, K., Pahud, M., Coddington, N., Rodenhouse, J., Wilson, A., Benko, H., and Buxton, B. Pen + touch = new tools. In Proc. UIST'10, 27--36.
13. Holz, C., and Baudisch, P. Fiberio: A touchscreen that senses fingerprints. In Proc. UIST'13, 41--50.
14. Käser, D. P., Agrawala, M., and Pauly, M. FingerGlass: efficient multiscale interaction on multitouch screens. In Proc. CHI'11, 1601--1610.
15. Kung, P., Küser, D., Schroeder, C., DeRose, T., Greenberg, D., and Kin, K. An augmented multi-touch system using hand and finger identification. In CHI EA'12, 1431--1432.
16. Kurtenbach, G., and Buxton, W. The limits of expert performance using hierarchic marking menus. In Proc. CHI'93, 482--487.
17. Lane, D. M., Napier, A. H., Peres, C. S., and Sándor, A. Hidden costs of graphical user interfaces: Failure to make the transition from menus and icon toolbars to keyboard shortcuts. IJHCI 2, 18 (2005), 133--144.
18. Lepinski, G. J., Grossman, T., and Fitzmaurice, G. The design and evaluation of multitouch marking menus. In Proc. CHI'10, 2233--2242.
19. Mackay, W. Which interaction technique works when? Floating palettes, marking menus and toolglasses support different task strategies. In Proc. AVI'02, 203--208.
20. Malacria, S., Bailly, G., Harrison, J., Cockburn, A., and Gutwin, C. Promoting hotkey use through rehearsal with ExposeHK. In Proc. CHI'13, 573--582.
21. Malik, S., Ranjan, A., and Balakrishnan, R. Interacting with large displays from a distance with vision-tracked multi-finger gestural input. In Proc. UIST'05, 43--52.
22. Marquardt, N., Kiemer, J., Ledo, D., Boring, S., and Greenberg, S. Designing user-, hand-, and handpart-aware tabletop interactions with the TouchID toolkit. In Proc. ITS'11, 21--30.
23. Sugiura, A., and Koseki, Y. A user interface using fingerprint recognition: holding commands and data objects on fingers. In Proc. UIST'98, 71--79.
24. Vogel, D., and Casiez, G. Conté: multimodal input inspired by an artist's crayon. In Proc. UIST'11, 357--366.
25. Wang, F., Cao, X., Ren, X., and Irani, P. Detecting and leveraging finger orientation for interaction with direct-touch surfaces. In Proc. UIST'09, 23--32.
26. Wang, J., and Canny, J. FingerSense: augmenting expressiveness to physical pushing button by fingertip identification. In CHI EA'04, 1267--1270.
27. Wigdor, D., Benko, H., Pella, J., Lombardo, J., and Williams, S. Rock & rails: extending multi-touch interactions with shape gestures to enable precise spatial manipulations. In Proc. CHI'11, 1581--1590.
28. Wobbrock, J. O., Findlater, L., Gergle, D., and Higgins, J. J. The aligned rank transform for nonparametric factorial analyses using only anova procedures. In Proc. CHI'11, 143--146.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)