Escape: a target selection technique using visually-cued gestures

ABSTRACT

Many mobile devices have touch-sensitive screens that people interact with using fingers or thumbs. However, such interaction is difficult because targets become occluded, and because fingers and thumbs have low input resolution. Recent research has addressed occlusion through visual techniques. However, the poor resolution of finger and thumb selection still limits selection speed. In this paper, we address the selection speed problem through a new target selection technique called Escape. In Escape, targets are selected by gestures cued by icon position and appearance. A user study shows that for targets six to twelve pixels wide, Escape performs at a similar error rate and at least 30% faster than Shift, an alternative technique, on a similar task. We evaluate Escape's performance in different circumstances, including different icon sizes, icon overlap, use of color, and gesture direction. We also describe an algorithm that assigns icons to targets, thereby improving Escape's performance.

References

1. Accot, J. and Zhai, S. More than dotting the i's ---- foundations for crossing-based interfaces. In Proceedings of CHI '02, ACM Press (2002), 73--80.
2. Albinsson, P. and Zhai, S. High precision touch screen interaction. In Proceedings of CHI '03, ACM Press (2003), 105--112.
3. Benko, H., Wilson, A. D., and Baudisch, P. Precise selection techniques for multi-touch screens. In Proceedings of CHI '06, ACM Press (2006), 1263--1272.
4. Fitts, P. M. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology, 47(6), (1954), 381--391.
5. Grossman, T., and Balakrishnan, R. The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area. In Proceedings of CHI '05, ACM Press (2005), 281--290.
6. Guiard, Y., Blanch, R., and Beaudouin-Lafon, M. Object pointing: a complement to bitmap pointing in GUIs. In Proceedings of GI '04, ACM Press (2004), 9--16.
7. Hinckley, K., Baudisch, P., Ramos, G., and Guimbretiere, F. Design and analysis of delimiters for selection-action pen gesture phrases in scriboli. In Proceedings of CHI '05, ACM Press (2005), 451--460.
8. Johnson, D. S. Approximation algorithms for combinatorial problems. Journal of Computer and System Sciences, 9(3), (1974), 256--278.
9. Karlson, A. K., and Bederson, B. B. ThumbSpace: generalized one-handed input for touchscreen-based mobile devices, In Proceedings of INTERACT '07, Springer (2007), 324--338.
10. Karlson, A. K., Bederson, B. B., Contreras-Vidal, J. Understanding one handed use of mobile devices, Handbook of Research on User Interface Design and Evaluation for Mobile Technology, Idea Group, 2007.
11. Karlson, A. K., Bederson, B. B., and SanGiovanni, J. AppLens and LaunchTile: two designs for one-handed thumb use on small devices. In Proceedings of CHI '05, ACM Press (2005), 201--210.
12. Kurtenbach, G. and Buxton, W. The limits of expert performance using hierarchical marking menus. In INTERCHI '93, ACM Press (1993), 482--487.
13. Parhi, P., Karlson, A. K., and Bederson, B. B. Target size study for one-handed thumb use on small touchscreen devices. In Proceedings of MobileHCI '06, ACM Press (2006), 203--210.
14. Perlin, K. Quikwriting: continuous stylus-based text entry. In Proceedings of the UIST '98, ACM Press (1998), 215--216.
15. Potter, R. L., Weldon, L. J., and Shneiderman, B. Improving the accuracy of touch screens: an experimental evaluation of three strategies. In Proceedings of CHI '88, ACM Press (1988), 27--32.
16. Sears, A. and B. Shneiderman, High precision touchscreens: design strategies and comparison with a mouse. International Journal of Man--Machine Studies, 43(4), (1991), 593--613.
17. Vogel, D. and Baudisch, P. Shift: a technique for operating pen-based interfaces using touch. In Proceedings of CHI '07, ACM Press (2007), 657--666.
18. Zhao, S., Agrawala, M., and Hinckley, K. Zone and polygon menus: using relative position to increase the breadth of multi-stroke marking menus. In Proceedings of CHI'06, ACM Press (2006), 1077--1086.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Touch screens

    • Interaction paradigms