research-article

Free access

Handle Flags: efficient and flexible selections for inking applications

Authors:

Patrick Baudisch,

Ken HinckleyAuthors Info & Claims

GI '09: Proceedings of Graphics Interface 2009

Pages 167 - 174

Published: 25 May 2009 Publication History

Abstract

There are a number of challenges associated with content selection in pen-based interfaces. Supplementary buttons to enter a selection mode may not be available, and selections may require a careful and error prone lasso stroke. In this paper we describe the design and evaluation of Handle Flags, a new localized technique used to select and perform commands on ink strokes in pen-operated interfaces. When the user positions the pen near an ink stroke, Handle Flags are displayed for the potential selections that the ink stroke could belong to (such as proximal strokes comprising a word or drawing). Tapping the handle allows the user to access the corresponding selection, without requiring a complex lasso stroke. Our studies show that Handle Flags offer significant benefits in comparison to traditional techniques, and are a promising technique for pen-based applications.

References

[1]

Accot, J. and Zhai, S. (1997). Beyond Fitts' Law: Models for trajectory-based HCI tasks. ACM CHI. 295--302.

Digital Library

[2]

Accot, J. and Zhai, S. (2002) More than dotting the i's - foundations for crossing-based interfaces. ACM CHI. 73--80.

Digital Library

[3]

Alvarado, C. (2004). Sketch Recognition User Interfaces: Guidelines for Design and Development. AAAI Fall Symposium on Intelligent Pen-based Interfaces. 8--14.

[4]

Buxton, W., Fiume, E., Hill, R., Lee, A. and Woo, C. (1983). Continuous Hand-Gesture Driven Input. Graphic Interface. 191--195.

[5]

Deming, K. and Lank, E. (2004). Managing Ambiguous Intention in Mode Inferencing. Proc of the AAAI Fall Symposium Series. 49--54.

[6]

Fitzmaurice, G., Balakrishnan, R. and Kurtenbach, G. (1999). An exploration into supporting artwork orientation in the user interface. ACM CHI. 167--174.

Digital Library

[7]

Fitzmaurice, G., Khan, A., Pieke, R., Buxton, B. and Kurtenbach, G. (2003). Tracking menus. ACM UIST. 71--79.

Digital Library

[8]

Grossman, T., Hinckley, K., Baudisch, P., Agrawala, M. and Balakrishnan, R. (2006). Hover widgets: using the tracking state to extend the capabilities of pen-operated devices. ACM CHI. 861--870.

Digital Library

[9]

Guiard, Y. (1987). Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of Motor Behavior. 19(4): 486--517.

[10]

Hinckley, K., Baudisch, P., Ramos, G. and Guimbretiere, F. (2005). Design and analysis of delimiters for selection-action pen gesture phrases in scriboli. ACM CHI. 451--460.

Digital Library

[11]

Hinckley, K., Guimbretiere, F., Agrawala, M., Apitz, G. and Chen, N. (2006). Phrasing techniques for multi-stroke selection gestures. Graphic Interface. 147--154.

Digital Library

[12]

Hinckley, K., Guimbretiere, F., Baudisch, P., Sarin, R., Agrawala, M. and Cutrell, E. (2006). The springboard: multiple modes in one spring-loaded control. ACM CHI. 181--190.

Digital Library

[13]

Kurtenbach, G. and Buxton, W. (1991). Issues in combining marking and direct manipulation techniques. ACM UIST. 137--144.

Digital Library

[14]

Lank, E. and Saund, E. (2005). Sloppy Selection: Providing an Accurate Interpretation of Imprecise Stylus Selection Gestures. Computers and Graphics. 29(4): 490--500.

Digital Library

[15]

Li, Y., Hinckley, K., Guan, Z. and Landay, J. A. (2005). Experimental analysis of mode switching techniques in pen-based user interfaces. ACM CHI. 461--470.

Digital Library

[16]

Mankoff, J., Hudson, S. and Abowd, G. (2000). Interaction techniques for ambiguity resolution in recognition based interfaces. ACM UIST. 11--20.

Digital Library

[17]

Mizobuchi, S. and Yasumura, M. (2004). Tapping vs. circling selections on pen-based devices: evidence for different performance-shaping factors. ACM CHI. 607--614.

Digital Library

[18]

Moran, T. P., Chiu, P., Melle, W. v. and Kurtenbach, G. (1997). Penbased interaction techniques for organizing material on an electronic whiteboard. ACM UIST. 127--136.

Digital Library

[19]

Mynatt, E., Igarashi, T., Edwards, W. and LaMarca, A. (1999). Flatland: New dimensions in office whiteboards. ACM CHI. 346--353.

Digital Library

[20]

Norman, D. A. (1981). Categorization of Action Slips. Psychology Review. 88(1): 1--15.

[21]

Plamondon, R. and Srihari, S. (2000). On-line and Offline Handwriting Recognition: A Comprehensive Survey. IEEE Pattern Analysis. 22(1): 63--84.

Digital Library

[22]

Ramos, G., Robertson, G., Czerwinski, M., Tan, D., Baudisch, P., Hinckley, K. and Agrawala, M. (2006). Tumble! Splat! helping users access and manipulate occluded content in 2D drawings. AVI. 428--435.

Digital Library

[23]

Ren, X. and Moriya, S. (2000). Improving selection performance on pen-based systems: a study of pen-based interaction for selection tasks. ACM TOCHI. 7(3): 384--416.

Digital Library

[24]

Saund, E., Fleet, D., Larner, D. and Mahoney, J. (2003). Perceptually-supported image editing of text and graphics. ACM UIST. 183--192.

Digital Library

[25]

Saund, E. and Lank, E. (2003). Stylus input and editing without prior selection of mode. ACM UIST. 213--216.

Digital Library

[26]

Saund, E., Mahoney, J., Fleet, D., Larner, D. and Lank, E. (2002). Perceptual Organization as a Foundation for Intelligent Sketch Editing. AAAI Symposium on Sketch Understanding. 118--125.

[27]

Saund, E. and Moran, T. P. (1994). A perceptually-supported sketch editor. ACM UIST. 175--184.

Digital Library

[28]

Sellen, A., Kurtenbach, G. and Buxton, W. (1992). The prevention of mode errors through sensory feedback. Human Computer Interaction. 7(2): 141--164.

Digital Library

[29]

Zeleznik, R. and Miller, T. (2006). Fluid inking: augmenting the medium of free-form inking with gestures. Graphics Interface. 155--162.

Digital Library

Cited By

Webb AKerne ABrown ZKim JKellogg EHancock MMarquardt NSchöning JTory M(2016)LayerFishProceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces10.1145/2992154.2992171(189-198)Online publication date: 6-Nov-2016
https://dl.acm.org/doi/10.1145/2992154.2992171
Perteneder FBresler MGrossauer ELeong JHaller MLatulipe CHartmann BGrossman T(2015)cLusterProceedings of the 28th Annual ACM Symposium on User Interface Software & Technology10.1145/2807442.2807455(37-46)Online publication date: 5-Nov-2015
https://dl.acm.org/doi/10.1145/2807442.2807455
Appert CChapuis OPietriga ELobo M(2015)Reciprocal Drag-and-DropACM Transactions on Computer-Human Interaction10.1145/278567022:6(1-36)Online publication date: 24-Sep-2015
https://dl.acm.org/doi/10.1145/2785670
Show More Cited By

Index Terms

Handle Flags: efficient and flexible selections for inking applications
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Inkeraction: An Interaction Modality Powered by Ink Recognition and Synthesis
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

Ink is a powerful medium for note-taking and creativity tasks. Multi-touch devices and stylus input have enabled digital ink to be editable and searchable. To extend the capabilities of digital ink, we introduce Inkeraction, an interaction modality ...
Model for unistroke writing time
CHI '01: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Unistrokes are a viable form of text input in pen-based user interfaces. However, they are a very heterogeneous group of gestures the only common feature being that all are drawn with a single stroke. Several unistroke alphabets have been proposed ...
Phrasing techniques for multi-stroke selection gestures
GI '06: Proceedings of Graphics Interface 2006

Pen gesture interfaces have difficulty supporting arbitrary multiple-stroke selections because lifting the pen introduces ambiguity as to whether the next stroke should add to the existing selection, or begin a new one. We explore and evaluate ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

GI '09: Proceedings of Graphics Interface 2009

May 2009

257 pages

ISBN:9781568814704

Program Chairs:
Amy Gooch
University of Victoria, Canada
,
Melanie Tory
University of Victoria, Canada

Sponsors

The Canadian Human-Computer Communications Society / Société Canadienne du Dialogue Humaine Machine (CHCCS/SCDHM)

Publisher

Canadian Information Processing Society

Canada

Publication History

Published: 25 May 2009

Author Tags

Qualifiers

Research-article

Acceptance Rates

GI '09 Paper Acceptance Rate 28 of 77 submissions, 36%;

Overall Acceptance Rate 206 of 508 submissions, 41%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
378
Total Downloads

Downloads (Last 12 months)46
Downloads (Last 6 weeks)14

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Webb AKerne ABrown ZKim JKellogg EHancock MMarquardt NSchöning JTory M(2016)LayerFishProceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces10.1145/2992154.2992171(189-198)Online publication date: 6-Nov-2016
https://dl.acm.org/doi/10.1145/2992154.2992171
Perteneder FBresler MGrossauer ELeong JHaller MLatulipe CHartmann BGrossman T(2015)cLusterProceedings of the 28th Annual ACM Symposium on User Interface Software & Technology10.1145/2807442.2807455(37-46)Online publication date: 5-Nov-2015
https://dl.acm.org/doi/10.1145/2807442.2807455
Appert CChapuis OPietriga ELobo M(2015)Reciprocal Drag-and-DropACM Transactions on Computer-Human Interaction10.1145/278567022:6(1-36)Online publication date: 24-Sep-2015
https://dl.acm.org/doi/10.1145/2785670
Zillner JRhemann CIzadi SHaller MBenko HDontcheva MWigdor D(2014)3D-boardProceedings of the 27th annual ACM symposium on User interface software and technology10.1145/2642918.2647393(471-479)Online publication date: 5-Oct-2014
https://dl.acm.org/doi/10.1145/2642918.2647393
Lindlbauer DHaller MHancock MScott SStuerzlinger WQuigley AJacucci GHorn MNacenta M(2013)Perceptual groupingProceedings of the 2013 ACM international conference on Interactive tabletops and surfaces10.1145/2512349.2512801(51-60)Online publication date: 6-Oct-2013
https://dl.acm.org/doi/10.1145/2512349.2512801
Herrlich MWalther-Franks BSchröder-Kroll RHolthusen JMalaka R(2011)Proxy-based selection for occluded and dynamic objectsProceedings of the 11th international conference on Smart graphics10.5555/2032567.2032588(142-145)Online publication date: 18-Jul-2011
https://dl.acm.org/doi/10.5555/2032567.2032588
Leitner JHaller MPierce JAgrawala MKlemmer S(2011)Harpoon selectionProceedings of the 24th annual ACM symposium on User interface software and technology10.1145/2047196.2047275(593-602)Online publication date: 16-Oct-2011
https://dl.acm.org/doi/10.1145/2047196.2047275
Negulescu MRuiz JLank ELaViola JLéon JAlexa MDo E(2010)Exploring usability and learnability of mode inferencing in pen/tablet interfacesProceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium10.5555/1923363.1923379(87-94)Online publication date: 7-Jun-2010
https://dl.acm.org/doi/10.5555/1923363.1923379
Zaman LStuerzlinger WMould DNoël S(2010)A new interface for cloning objects in drawing systemsProceedings of Graphics Interface 201010.5555/1839214.1839220(27-34)Online publication date: 31-May-2010
https://dl.acm.org/doi/10.5555/1839214.1839220
Marinkas DZeleznik RLaViola JCarr NSamavati FGrimm CLaViola J(2009)Shadow buttonsProceedings of the 6th Eurographics Symposium on Sketch-Based Interfaces and Modeling10.1145/1572741.1572768(159-164)Online publication date: 1-Aug-2009
https://dl.acm.org/doi/10.1145/1572741.1572768

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten