Improving drag-and-drop on wall-size displays

ABSTRACT

On wall-size displays with pen or touch input, users can have difficulties reaching display contents located too high, too low, or too far away. Drag-and-drop interactions can be further complicated by bezels separating individual display units. Researchers have proposed a variety of interaction techniques to address this issue, such as extending the user's reach (e.g., push-and-throw) and bringing potential targets to the user (drag-and-pop). In this paper, we introduce a new technique called push-and-pop that combines the strengths of push-and-throw and drag-and-pop. We present two user studies comparing six different techniques designed for extending drag-and-drop to wall-size displays. In both studies, participants were able to file icons on a wall-size display fastest when using the push-and-pop interface.

REFERENCES

• 1: Johnny Accot , Shumin Zhai, Beyond Fitts' law: models for trajectory-based HCI tasks, Proceedings of the SIGCHI conference on Human factors in computing systems, p.295-302, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258760]
• 2: Baudisch, P., Cutrell, E., and Robertson, G. High-Density Cursor: A Visualization Technique that Helps Users Keep Track of Fast-Moving Mouse Cursors. In Proc. Interact'03, pp. 236--243.
• 3: Baudisch, P., Cutrell, E., Robbins, D., Czerwinski, M., Tandler, P. Bederson, B., and Zierlinger, A. Drag-and-Pop and Drag-and-Pick: Techniques for Accessing Remote Screen Content on Touch and Pen-operated Systems. In Proc Interact'03, pp. 57--64.
• 4: Renaud Blanch , Yves Guiard , Michel Beaudouin-Lafon, Semantic pointing: improving target acquisition with control-display ratio adaptation, Proceedings of the SIGCHI conference on Human factors in computing systems, p.519-526, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985758]
• 5: Coxeter, H. S. M. Introduction to Geometry, 2nd ed. NewYork: Wiley, pp. 69--70, 1969.
• 6: Scott Elrod , Richard Bruce , Rich Gold , David Goldberg , Frank Halasz , William Janssen , David Lee , Kim McCall , Elin Pedersen , Ken Pier , John Tang , Brent Welch, Liveboard: a large interactive display supporting group meetings, presentations, and remote collaboration, Proceedings of the SIGCHI conference on Human factors in computing systems, p.599-607, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.143052]
• 7: Azam Khan , George Fitzmaurice , Don Almeida , Nicolas Burtnyk , Gordon Kurtenbach, A remote control interface for large displays, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029655]
• 8: Jörg Geißler, Shuffle, throw or take it! working efficiently with an interactive wall, CHI 98 conference summary on Human factors in computing systems, p.265-266, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/286498.286745]
• 9: Guiard, Y., Blanch, R., and Beaudouin-Lafon, M. Vector Pointing: Object vs. Pixel Selection in Graphical User Interfaces. In Proc. GI'04, pp 9--16.
• 10: Yves Guiard , Michel Beaudouin-Lafon , Julien Bastin , Dennis Pasveer , Shumin Zhai, View size and pointing difficulty in multi-scale navigation, Proceedings of the working conference on Advanced visual interfaces, May 25-28, 2004, Gallipoli, Italy [doi>10.1145/989863.989881]
• 11: François Guimbretière , Maureen Stone , Terry Winograd, Fluid interaction with high-resolution wall-size displays, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502353]
• 12: Hascoët, M. (2003). Throwing models for large displays. In Proc. HCI'03, pp. 73--77.
• 13: Brad Johanson , Greg Hutchins , Terry Winograd , Maureen Stone, PointRight: experience with flexible input redirection in interactive workspaces, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.572019]
• 14: Brad Johanson , Armando Fox , Terry Winograd, The Interactive Workspaces Project: Experiences with Ubiquitous Computing Rooms, IEEE Pervasive Computing, v.1 n.2, p.67-74, April 2002 [doi>10.1109/MPRV.2002.1012339 ]
• 15: Gordon Kurtenbach , William Buxton, User learning and performance with marking menus, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.258-264, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191759]
• 16: I. Scott MacKenzie , Shaidah Jusoh, An Evaluation of Two Input Devices for Remote Pointing, Proceedings of the 8th IFIP International Conference on Engineering for Human-Computer Interaction, p.235-250, May 11-13, 2001
• 17: MacKenzie, I. S., Fitts' law as a research and design tool in human-computer interaction. Human Computer Interaction, 1992, 7, pp. 91--139.
• 18: Brad A. Myers , Rishi Bhatnagar , Jeffrey Nichols , Choon Hong Peck , Dave Kong , Robert Miller , A. Chris Long, Interacting at a distance: measuring the performance of laser pointers and other devices, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503383]
• 19: Dan R. Olsen, Jr. , Travis Nielsen, Laser pointer interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.17-22, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365030]
• 20: Ivan Poupyrev , Mark Billinghurst , Suzanne Weghorst , Tadao Ichikawa, The go-go interaction technique: non-linear mapping for direct manipulation in VR, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.79-80, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237102]
• 21: Jun Rekimoto , Masanori Saitoh, Augmented surfaces: a spatially continuous work space for hybrid computing environments, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.378-385, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303113]
• 22: Jun Rekimoto, Pick-and-drop: a direct manipulation technique for multiple computer environments, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.31-39, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263505]
• 23: Smith, D. C., Irby, C., Kimball, R., Verplank, W., and Harslem, E. Designing the Star user interface, Byte 7(4):242--282, 1982.
• 24: Richard Stoakley , Matthew J. Conway , Randy Pausch, Virtual reality on a WIM: interactive worlds in miniature, Proceedings of the SIGCHI conference on Human factors in computing systems, p.265-272, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223938]
• 25: Streitz, N. A., Tandler, P. Müller-Tomfelde, C., Konomi, S. Roomware. In: Carroll, J. A. (Ed.), Human-Computer Interaction in the New Millennium, Addison Wesley, pp. 553--578, 2001.
• 26: Annette Wagner , Patrick Curran , Robert O'Brien, Drag me, drop me, treat me like an object, Proceedings of the SIGCHI conference on Human factors in computing systems, p.525-530, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223975]
• 27: Shumin Zhai , Carlos Morimoto , Steven Ihde, Manual and gaze input cascaded (MAGIC) pointing, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.246-253, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303053]

INDEX TERMS

Keywords:
drag-and-drop, drag-and-pop, interaction technique, pen input, push-and-throw, touch-screen, wall-size display