research-article

The design and evaluation of multitouch marking menus

Authors:

G. Julian Lepinski,

George FitzmauriceAuthors Info & Claims

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2233 - 2242

https://doi.org/10.1145/1753326.1753663

Published: 10 April 2010 Publication History

Abstract

Despite the considerable quantity of research directed towards multitouch technologies, a set of standardized UI components have not been developed. Menu systems provide a particular challenge, as traditional GUI menus require a level of pointing precision inappropriate for direct finger input. Marking menus are a promising alternative, but have yet to be investigated or adapted for use within multitouch systems. In this paper, we first investigate the human capabilities for performing directional chording gestures, to assess the feasibility of multitouch marking menus. Based on the positive results collected from this study, and in particular, high angular accuracy, we discuss our new multitouch marking menu design, which can increase the number of items in a menu, and eliminate a level of depth. A second experiment showed that multitouch marking menus perform significantly faster than traditional hierarchal marking menus, reducing acquisition times in both novice and expert usage modalities.

Supplementary Material

JPG File (p2233.jpg)

Download
6.02 KB

MOV File (p2233.mov)

Download
7.77 MB

References

[1]

Apple iPhone, http://www.apple.com/iphone/

[2]

Bailly, G., Lecolinet, E., and Nigay, L. (2008). Flower menus: a new type of marking menu with large menu breadth, within groups and efficient expert mode memorization. ACM AVI. 15--22.

Digital Library

[3]

Bau, O. and Mackay, W.E. (2008). OctoPocus: a dynamic guide for learning gesture-based command sets. ACM UIST. 37--46.

Digital Library

[4]

Benko, H., Wilson, A.D., Baudisch, P. (2006). Precise selection techniques for multi-touch screens. ACM CHI. 1263--1272.

Digital Library

[5]

Brandl, P., Forlines, C. Wigdor, D., Haller, M., Shen, C. (2008). Combining and Measuring the Benefits of Bimanual Pen and Direct-Touch Interaction on Horizontal Interfaces. ACM AVI. 154--161.

Digital Library

[6]

Brandl, P., Seifried, T., Leitner, J., Haller, M., Doray, B., and To, P. (2009). Occlusion-Aware Menu Design for Digital Tabletops. ACM CHI. 3223--3228.

Digital Library

[7]

Card, S.K. (1982). User perceptual mechanisms in the search of computer command menus. ACM CHI. 190--196.

Digital Library

[8]

Davidson, P.L. and Han, J.Y. (2008). Extending 2D object arrangement with pressure-sensitive layering cues. ACM UIST. 87--90.

Digital Library

[9]

Dietz, P. and Leigh, D. (2001). DiamondTouch: a multi-user touch technology. ACM UIST. 219--226.

Digital Library

[10]

Esenther, A. and Ryall, K. (2006). Fluid DTMouse: better mouse support for touch-based interactions. AVI. 112--115.

Digital Library

[11]

Fingerworks, Inc. (2008). User's Guide. http://www.fingerworks.com/gesture_guide_mouse.html

[12]

Freeman, D., Benko, H., Ringel-Morris, M., Wigdor, D. (2009). ShadowGuides: Visualizations for In-Situ Learning of Multi-Touch and Whole-Hand Gestures. ACM ITS.

Digital Library

[13]

Han, J.Y. (2005). Low-cost multi-touch sensing through frustrated total internal reflection. ACM UIST. 115--118.

Digital Library

[14]

Jacob, R, A. Girouard, L.M. Hirshfield, M.S. Horn, O. Shaer, E.T. Solovey, and J. Zigelbaum. (2008). Reality-Based Interaction: A Framework for Post-WIMP Interfaces. ACM CHI. 201--210.

Digital Library

[15]

Kurtenbach, G., Buxton, W. (1993). The limits of expert performance using hierarchic marking menus. ACM Interact/CHI. 482--487.

Digital Library

[16]

Kurtenbach, G., Sellen, A., Buxton, W. (1993). An empirical evaluation of some articulatory and cognitive aspects of marking menus. Journal of Human Computer Interaction, 8(1):1--23.

Digital Library

[17]

Kurtenbach, G., Fitzmaurice, G.W., Owen, R.N., and Baudel, T. (1999). The Hotbox: efficient access to a large number of menu-items. ACM CHI. 231--237.

Digital Library

[18]

Lenman, S., Bretzner, L., and Thuresson, B. (2002). Using marking menus to develop command sets for computer vision based hand gesture interfaces. ACM NORDCHI. 239--242.

Digital Library

[19]

Li, Y., Hinckley, K., Guan, Z., and Landay, J. (2005). Experimental Analysis of Mode Switching Techniques in Pen-based User Interfaces. ACM CHI. 461--470.

Digital Library

[20]

Lyons, K., Starner, T., Gane, B. (2006). Experimental evaluations of the Twiddler one--handed chording mobile keyboard. Human-Computer Interaction. 21(4):343--392.

Digital Library

[21]

Malik, S., Ranjan, A., Balakrishnan. R. (2005). Interacting with large displays from a distance with vision-tracked multi-finger gestural input. ACM UIST. 43--52.

Digital Library

[22]

Matejka, J., Grossman, T., Lo, J., and Fitzmaurice, G. (2009). The design and evaluation of multi-finger mouse emulation techniques. ACM CHI. 1073--1082.

Digital Library

[23]

Potter, R.L., Weldon, L.J., Shneiderman, B. (1988). Improving the accuracy of touch screens: an experimental evaluation of three strategies. ACM CHI. 27--32.

Digital Library

[24]

Rekimoto, J. (2002). SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. ACM CHI. 113--120.

Digital Library

[25]

Rosenberg, I.D., Grau, A., Hendee, C., Awad, N., and Perlin, K. (2009). IMPAD: an inexpensive multi-touch pressure acquisition device. ACM CHI EA, 3217--3222.

Digital Library

[26]

Scott, S., Carpendale, S., and Inkpen, K. (2004). Territoriality in collaborative tabletop workspaces. ACM CSCW. 294--303.

Digital Library

[27]

Shen, C., Vernier, F.D., Forlines, C., Ringel, M. (2004). DiamondSpin: An Extensible Toolkit for Around--the--Table Interaction. ACM CHI. 167--174.

Digital Library

[28]

Vogel, D. and Baudisch, P. (2007). Shift: a technique for operating pen-based interfaces using touch. ACM CHI. 657--666.

Digital Library

[29]

Wang, F., Ren, X., Cao, X., Irani, P. (2009). Detecting and Leveraging Finger Orientation for Interaction with Direct-Touch Surfaces. ACM UIST. 23--32.

Digital Library

[30]

Wigdor, D., Balakrishnan, R. (2004). A comparison of consecutive and concurrent input text entry techniques for mobile phones. ACM CHI. 81--88.

Digital Library

[31]

Wigdor, D., Fletcher, J., and Morrison, G. (2009). Designing user interfaces for multi-touch and gesture devices. ACM CHI. 2755--2758.

Digital Library

[32]

Wilson, A. (2005). PlayAnywhere: A Compact Tabletop Computer Vision System. ACM UIST. 83--92.

Digital Library

[33]

Wobbrock, J.O., Morris, M.R. and Wilson, A.D. (2009) User-defined gestures for surface computing. ACM CHI. 1083--1092.

Digital Library

[34]

Wu, M., Balakrishnan, R. (2003). Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. ACM UIST. 193--202.

Digital Library

[35]

Zhao, S., Balakrishnan, R. (2004). Simple vs. compound mark hierarchical marking menus. ACM UIST. 33--42.

Digital Library

[36]

Zhao, S., Agrawala, M., Hinckley, K. (2006). Zone and polygon menus: using relative position to increase the breadth of multi-stroke marking menus. ACM CHI. 1077--1086.

Digital Library

Cited By

Abdullah SUddin M(2024)Revisiting FastTap: Effects of Increasing Command Capacity of Spatial Memory Menus in Tablets2024 IEEE 15th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON)10.1109/UEMCON62879.2024.10754660(0683-0689)Online publication date: 17-Oct-2024
https://doi.org/10.1109/UEMCON62879.2024.10754660
Perelman GDubois ESerrano M(2024)Dual-Thumb pointing and command selection techniques for tabletsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103203184:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103203
Soha SMazumder ARabbi FChowdhury FHasan K(2024)Exploring Optimal Placement of Head-Based Hierarchical Marking Menus on SmartphonesMobile and Ubiquitous Systems: Computing, Networking and Services10.1007/978-3-031-63992-0_25(381-392)Online publication date: 19-Jul-2024
https://doi.org/10.1007/978-3-031-63992-0_25
Show More Cited By

Index Terms

The design and evaluation of multitouch marking menus
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

The limits of expert performance using hierarchic marking menus
CHI '93: Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems

A marking menu allows a user to perform a menu selection by either popping-up a radial (or pie) menu, or by making a straight mark in the direction of the desired menu item without popping-up the menu. A hierarchic marking menu uses hierarchic radial ...
Simple vs. compound mark hierarchical marking menus
UIST '04: Proceedings of the 17th annual ACM symposium on User interface software and technology

We present a variant of hierarchical marking menus where items are selected using a series of inflection-free simple marks, rather than the single "zig-zag" compound mark used in the traditional design. Theoretical analysis indicates that this simple ...
Control menus: excecution and control in a single interactor
CHI EA '00: CHI '00 Extended Abstracts on Human Factors in Computing Systems

We propose a new type of contextual pop-up menu called a control menu. These menus combine the selection of an operation and the control of this operation. They integrate up to two scroll bars or spin-boxes and thus allow users to keep their attention ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2010

2690 pages

ISBN:9781605589299

DOI:10.1145/1753326

General Chair:
Elizabeth Mynatt
Georgia Institute of Technology
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Scott Hudson
Carnegie Mellon University
,
Keith Edwards
Georgia Tech
,
Tom Rodden
University of Nottingham

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 April 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '10

Sponsor:

SIGCHI

CHI '10: CHI Conference on Human Factors in Computing Systems

April 10 - 15, 2010

Georgia, Atlanta, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

92
Total Citations
View Citations
2,317
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Abdullah SUddin M(2024)Revisiting FastTap: Effects of Increasing Command Capacity of Spatial Memory Menus in Tablets2024 IEEE 15th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON)10.1109/UEMCON62879.2024.10754660(0683-0689)Online publication date: 17-Oct-2024
https://doi.org/10.1109/UEMCON62879.2024.10754660
Perelman GDubois ESerrano M(2024)Dual-Thumb pointing and command selection techniques for tabletsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103203184:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103203
Soha SMazumder ARabbi FChowdhury FHasan K(2024)Exploring Optimal Placement of Head-Based Hierarchical Marking Menus on SmartphonesMobile and Ubiquitous Systems: Computing, Networking and Services10.1007/978-3-031-63992-0_25(381-392)Online publication date: 19-Jul-2024
https://doi.org/10.1007/978-3-031-63992-0_25
Petersen DGellert EBöhmer M(2023)Extending the Interaction Space of Rotary Knobs by Multi-touch-based Grasp RecognitionProceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia10.1145/3626705.3627797(198-209)Online publication date: 3-Dec-2023
https://dl.acm.org/doi/10.1145/3626705.3627797
Hu Fleischhauer YSurale HAlt FPfeuffer K(2023)Gaze-based Mode-Switching to Enhance Interaction with Menus on TabletsProceedings of the 2023 Symposium on Eye Tracking Research and Applications10.1145/3588015.3588409(1-8)Online publication date: 30-May-2023
https://dl.acm.org/doi/10.1145/3588015.3588409
Faisandaz GGoguey AJouffrais CNigay L(2023)µGeT: Multimodal eyes-free text selection technique combining touch interaction and microgesturesProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3614131(594-603)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3614131
Goguey AOrtega M(2023)Studies and guidelines for two concurrent stroke gesturesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102942170:COnline publication date: 1-Feb-2023
https://dl.acm.org/doi/10.1016/j.ijhcs.2022.102942
Guo XLin HMa SYang ZLi H(2023)Effect of the predictive keyboard with magnification and protrusion on the bare-hand input in virtual realityMultimedia Tools and Applications10.1007/s11042-023-15071-z82:20(31821-31838)Online publication date: 17-Mar-2023
https://doi.org/10.1007/s11042-023-15071-z
Faisandaz GGoguey AJouffrais CNigay L(2022)Keep in Touch: Combining Touch Interaction with Thumb-to-Finger µGestures for People with Visual ImpairmentProceedings of the 2022 International Conference on Multimodal Interaction10.1145/3536221.3556589(105-116)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3536221.3556589
Duan YHe KFeng JLu JZhou J(2022)Estimating 3D Finger Pose via 2D-3D Fingerprint MatchingProceedings of the 27th International Conference on Intelligent User Interfaces10.1145/3490099.3511123(459-469)Online publication date: 22-Mar-2022
https://dl.acm.org/doi/10.1145/3490099.3511123
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten