Tilt menu: using the 3D orientation information of pen devices to extend the selection capability of pen-based user interfaces

ABSTRACT

We present a new technique called 'Tilt Menu' for better extending selection capabilities of pen-based interfaces. The Tilt Menu is implemented by using 3D orientation information of pen devices while performing selection tasks. The Tilt Menu has the potential to aid traditional one-handed techniques as it simultaneously generates the secondary input (e.g., a command or parameter selection) while drawing/interacting with a pen tip without having to use the second hand or another device. We conduct two experiments to explore the performance of the Tilt Menu. In the first experiment, we analyze the effect of parameters of the Tilt Menu, such as the menu size and orientation of the item, on its usability. Results of the first experiment suggest some design guidelines for the Tilt Menu. In the second experiment, the Tilt Menu is compared to two types of techniques while performing connect-the-dot tasks using freeform drawing mechanism. Results of the second experiment show that the Tilt Menu perform better in comparison to the Tool Palette, and is as good as the Toolglass.

References

1. Adobe Illustrator, http://www.adobe.com/products/illustrator/
2. Accot, J., Zhai, S., Beyond Fitts' Law: Models for Trajectory-Based HCI Tasks. In Proc. CHI 1997, ACM Press (1997), 295--302.
3. Arvo, J., Novins, K., Fluid Sketches: Continuous Recognition and Morphing of Simple Hand-Drawn Shapes. In Proc. UIST 2000, ACM Press (2000), 73--80.
4. Balakrishnan, R., Baudel, T., Kurtenbach, G., and Fitzmaurice, G., The Rockin'Mouse: integral 3D manipulation on a plane. In Proc. CHI 1997, ACM Press (1997), 311--318.
5. Balakrishnan, R., Hinckley, K., The role of kinesthetic reference frames in two-handed input performance. In Proc. UIST 1999, ACM Press (1999), 171--178.
6. Bier, E. A., Stone, M. C., Pier, K., Buxton, W., Derose, T. D., Toolglass and magic lenses: The see-through interface. In Proc. SIGGRAPH 1993, 73--80.
7. Callahan, J., Hopkins, D., Weiser, M., Shneiderman, B., An empirical comparison of pie vs. linear menus. In Proc. of CHI 1988, ACM Press (1988), 95--100.
8. Fitzmaurice, G., Khan, A., Pieké, R., Buxton, W., Kurtenbach, G., Tracking menus. In Proc UIST 2003, ACM Press (2003), 71--79.
9. Franke, K., The influence of physical and biomechanical processes on the ink trace methodological foundations for the forensic analysis of signatures, Ph.D. thesis, University of Groningen, The Netherlands, 2005.
10. Grossman T, Hinckley, K. Baudisch, P., Agrawala, M., Balakrishnan, R., Hover widgets: Using the tracking state to extend the capabilities of pen-operated devices. In Proc. CHI 2006, ACM Press (2006), 861--860.
11. Guimbretière, F., Winograd, T. FlowMenu: Combining command, text, and parameter entry. In Proc UIST 2000, ACM Press (2000). 213--216.
12. Guimbretière, F., Martin, A., Winograd, T., Benefits of merging command selection and direct manipulation. ACM TOCHI, 2005, 12 (3): 460--476.
13. Hinckley, K., Guimbretiere, F., Agrawala, M., Apitz, G., Chen, N., Phrasing techniques for multi-stroke selection gestures. GI, 147--154.
14. Jacob, R.J.K., Deligiannidis, L., Morrison, S., A Software Model and Specification Language for Non-WIMP User Interfaces. ACM TOCHI, 1999, 6(1): 1--46.
15. Jagadeesh Babu V., Prashanth L., Raghunath Sharma R., Prabhakara Rao G.V., Bharath A., HMM-based Online Handwriting Recognition System for Telugu Symbols, In Proc. ICDAR 2007, 23--26
16. Kabbash, P., Buxton, W., Sellen, A., Two-handed input in a compound task. In Proc. CHI 1994, ACM Press (1994), 417--423.
17. Kurtenbach, G. Buxton, W., The limits of expert performance using hierarchical marking menus. In Proc. CHI 1992, ACM Press (1992), 482--487.
18. Kurtenbach, G., Sellen, A., Buxton, W., An empirical evaluation of some articulatory and cognitive aspects of "marking menus". Human Computer Interaction, 1993. 8(1): 1--23.
19. Li, J., Zhang, X., Ao X., Dai G., Sketch recognition with continuous feedback based on incremental intention extraction, In Proc IUI 2005, ACM Press (2005), 145--150.
20. Li, Y., Hinckley, K., Guan Z., Landay, J.A., Experimental analysis of mode switching techniques in pen based user interfaces. In Proc. CHI 2005, ACM Press (2005), 461--470.
21. Odell, D., Davis, R., Smith, A., Wright, P. K., Toolglasses, Marking Menus, and Hotkeys: A Comparison of One and Two-Handed Command Selection Techniques, In Proc. GI 2004, 17--24.
22. Partridge, K., Chatterjee, S., Want, R., TiltType: Accelerometer-supported text entry for very small devices, In Proc. CHI 2001, ACM Press (2001), 201--204.
23. Pook, S., Lecolinet, E., Vaysseix, G., and Barillot, E., Control menu: Execution and control in a single interactor. In Proc. CHI 2000, ACM Press (2000), 263--264.
24. Solidworks, http://www.solidworks.com
25. Ramos, G., Boulos, M., Balakrishnan, R. Pressure Widgets. In Proc. CHI 2004, ACM Press (2004), 487--494.
26. Ramos, G., Balakrishnan, R. Zliding: fluid zooming and sliding for high precision parameter manipulation. In Proc. UIST 2005, ACM Press (2005), 143--152.
27. Ramos, G., Balakrishnan, R. Pressure Marks. In Proc. CHI 2007, ACM Press (2007), 1375--1384.
28. Saund, E., Lank, E., Stylus input and editing without prior selection of mode. In Proc. UIST 2003, ACM Press (2003), 213--216.
29. Tandler, P., Prante, T., Using Incremental Gesture Recognition to Provide Immediate Feedback while Drawing Pen Gestures. In Proc. UIST 2001, ACM Press (2001), 18--25.
30. Tian, F., Ao, X., Wang, H., Setlur, V., Dai G., The Tilt Cursor: Enhancing Stimulus-Response Compatibility Based on 3D Orientation Cue of Pen Devices. In Proc. CHI 2007, ACM Press (2007), 303--306.
31. Wigdor, D., Balakrishnan, R. TiltText: Using Tilt. for Text Input to Mobile Phones. In Proc. UIST 2003. ACM Press (2003), 81--90.
32. Zhao, S., Agrawala, M., Hinckley, K., Zone and Polygon Menus: Using Relative Position to Increase the Breadth of Multi-Stroke Marking. Menus, In Proc. CHI 2006, ACM Press (2006), 1077--1086.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • HCI theory, concepts and models

    • Interaction paradigms

      • Graphical user interfaces

  • Interaction design

    • Interaction design theory, concepts and paradigms