Phrasing techniques for multi-stroke selection gestures

ABSTRACT

Pen gesture interfaces have difficulty supporting arbitrary multiple-stroke selections because lifting the pen introduces ambiguity as to whether the next stroke should add to the existing selection, or begin a new one. We explore and evaluate techniques that use a non-preferred-hand button or touchpad to phrase together one or more independent pen strokes into a unitary multi-stroke gesture. We then illustrate how such phrasing techniques can support multiple-stroke selection gestures with tapping, crossing, lassoing, disjoint selection, circles of exclusion, selection decorations, and implicit grouping operations. These capabilities extend the expressiveness of pen gesture interfaces and suggest new directions for multiple-stroke pen input techniques.

REFERENCES

• 1: Johnny Accot , Shumin Zhai, More than dotting the i's --- foundations for crossing-based interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503390]
• 2: Georg Apitz , François Guimbretière, CrossY: a crossing-based drawing application, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029635]
• 3: Appert, C., Beaudouin-Lafon, M., Mackay, W. Context matters: Evaluating interaction techniques with the CIS model. Proc. HCI 2004, Springer Verlag, 279--295.
• 4: Buxton, W. An Informal Study of Selection-Positioning Tasks. Proceedings of Graphics Interface '82: 8th Conference of the Canadian Man-Computer Communications Society, 323--328.
• 5: Buxton, W. Chunking and Phrasing and the Design of Human-Computer Dialogues. Information Processing '86, Proc. IFIP 10th World Computer Congress, Amsterdam: North Holland, 475--480.
• 6: Buxton, W., Fiume, E., Hill, R., Lee, A., Woo, C. Continuous hand-gesture driven input. Proceedings of Graphics Interface'83, 191--195.
• 7: W. Buxton , B. Myers, A study in two-handed input, Proceedings of the SIGCHI conference on Human factors in computing systems, p.321-326, April 13-17, 1986, Boston, Massachusetts, United States
• 8: François Guimbretiére , Terry Winograd, FlowMenu: combining command, text, and data entry, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.213-216, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354778]
• 9: Ken Hinckley , Patrick Baudisch , Gonzalo Ramos , Francois Guimbretiere, Design and analysis of delimiters for selection-action pen gesture phrases in scriboli, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055035]
• 10: Ken Hinckley , Francois Guimbretiere , Patrick Baudisch , Raman Sarin , Maneesh Agrawala , Ed Cutrell, The springboard: multiple modes in one spring-loaded control, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124801]
• 11: Gordon Kurtenbach , William Buxton, Issues in combining marking and direct manipulation techniques, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.137-144, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120797]
• 12: Gordon Kurtenbach , George W. Fitzmaurice , Russell N. Owen , Thomas Baudel, The Hotbox: efficient access to a large number of menu-items, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.231-237, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303047]
• 13: Kurtenbach, G., Sellen, A., Buxton, W., An emprical evaluation of some articulatory and cognitive aspects of 'marking menus'. J. Human Computer Interaction, 1993. 8(1).
• 14: Joseph J. LaViola, Jr. , Robert C. Zeleznik, MathPad²: a system for the creation and exploration of mathematical sketches, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 15: Yang Li , Ken Hinckley , Zhiwei Guan , James A. Landay, Experimental analysis of mode switching techniques in pen-based user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055036]
• 16: Chunyuan Liao , François Guimbretière , Ken Hinckley, PapierCraft: a command system for interactive paper, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095074]
• 17: Mackay, W. E. Which Interaction Technique Works When? Floating Palettes, Marking Menus and Toolglasses Support Different Task Strategies. Proc. AVI 2002 International Conference on Advanced Visual Interfaces, ACM, 203--208.
• 18: Sachi Mizobuchi , Michiaki Yasumura, Tapping vs. circling selections on pen-based devices: evidence for different performance-shaping factors, Proceedings of the SIGCHI conference on Human factors in computing systems, p.607-614, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985769]
• 19: A Monk, Mode errors: a user-centered analysis and some preventative measures using keying-contingent sound, International Journal of Man-Machine Studies, v.24 n.4, p.313-327, April 1986
• 20: Thomas P. Moran , Patrick Chiu , William van Melle, Pen-based interaction techniques for organizing material on an electronic whiteboard, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.45-54, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263508]
• 21: Pier, K., Landay, J. A., Issues for Location-Independent Interfaces. 1992: Technical Report ISTL92--4, Xerox Palo Alto Research Center.
• 22: Stuart Pook , Eric Lecolinet , Guy Vaysseix , Emmanuel Barillot, Control menus: excecution and control in a single interactor, CHI '00 extended abstracts on Human factors in computing systems, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/633292.633446]
• 23: Eric Saund , Edward Lank, Stylus input and editing without prior selection of mode, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.213-216, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964720]
• 24: Abigail Sellen , Gordon Kurtenbach , William Buxton, The role of visual and kinesthetic feedback in the prevention of mode errors, Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction, p.667-673, August 27-31, 1990
• 25: Sellen, A., Kurtenbach, G., Buxton, W., The Prevention of Mode Errors through Sensory Feedback. J. Human Computer Interaction, 1992. 7(2): p. 141--164.
• 26: Shengdong Zhao , Ravin Balakrishnan, Simple vs. compound mark hierarchical marking menus, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029639]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
gestures, multiple strokes, pen input, phrasing, tablets