skip to main content
10.1145/1124772.1124817acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Article

Perspective cursor: perspective-based interaction for multi-display environments

Published: 22 April 2006 Publication History

Abstract

Multi-display environments and smart meeting rooms are now becoming more common. These environments build a shared display space from variety of devices: tablets, projected surfaces, tabletops, and traditional monitors. Since the different display surfaces are usually not organized in a single plane, traditional schemes for stitching the displays together can cause problems for interaction. However, there is a more natural way to compose display space -- using perspective. In this paper, we develop interaction techniques for multi-display environments that are based on the user's perspective on the room. We designed the Perspective Cursor, a mapping of cursor to display space that appears natural and logical from wherever the user is located. We conducted an experiment to compare two perspective-based techniques, the Perspective Cursor and a beam-based technique, with traditional stitched displays. We found that both perspective techniques were significantly faster for targeting tasks than the traditional technique, and that Perspective Cursor was the most preferred method. Our results show that integrating perspective into the design of multi-display environments can substantially improve performance.

References

[1]
Baudisch, P., Cutrell, E., Robbins, D., Czerwinski, M., Tandler, P. Bederson, B., and Zierlinger, A. Drag-and-Pop and Drag-and-Pick: Techniques for Accessing Remote Screen Content on Touch- and Pen-operated Systems. Proc. Interact 2003, 57--64.
[2]
Baudisch, P., Cutrell, E., Hinckley, K. and Gruen, R., Mouse Ether: Accelerating the Acquisition of Targets Across Multi-Monitor Displays. Proc ACM CHI 2004, 1379--1382.
[3]
Baudisch, P., and Rosenholtz, R. Halo: A Technique for Visualizing Off-Screen Locations. Proc. CHI 2003, 481--488.
[4]
Balakrishnan, R. ""Beating"" Fitts' Law: virtual enhancements for pointing facilitation. IJHCS, 61, 6, (2004), 857--874.
[5]
Benko, H. and Feiner, S. Multi-monitor mouse. Proc. CHI 2005, 1208--1211.
[6]
Biehl, J.T. and Bailey, B.P. ARIS: An Interface for Application Relocation in an Interactive Space, Proc. Graphics Interface, (2004), 107--116.
[7]
Bolt, R.A. "Put-that-there": Voice and gesture at the graphics interface. Proc. SIGGRAPH '80, 262--270.
[8]
Booth, K., Fisher, B., Lin, R., & Argue, R. The ""mighty mouse"" multi-screen collaboration tool. Proc. UIST 2002, 209--212.
[9]
Davis, J., and Chen, X. LumiPoint: Multi-user laser-based interaction on large tiled displays. Displays 2002, 23(5):205--211.
[10]
Deitz, P. and Leigh D. DiamondTouch: A Multi-User Touch Technology. Proc. UIST 2001, 219--226.
[11]
Fox, A., Johanson, B., Hanrahan, P., and Winograd, T. Integrating Information Appliances into an Interactive Workspace. IEEE CG&A 20, 3, (2000), 54--65.
[12]
Furnas, G. W., Generalized Eye Views. Proc. CHI 1986 16--23.
[13]
Geiβler, J. Shuffle, throw or take it! Working Efficiently with an Interactive Wall. Proc. CHI 1998, 265--266.
[14]
Grossman, T., and Balakrishnan, R. The Bubble Cursor: Enhancing target acquisition by dynamic resizing of the cursor's activation area. Proc. CHI 2005, 281--290.
[15]
Hascoët, M. Throwing models for large displays. Proc. HCI 2003, 73--77.
[16]
Hinckley, K. Synchronous Gestures for Multiple Users and Computers. Proc. UIST 2003, 149--158.
[17]
Hinckley, K., Ramos, G., Guimbretiere, F., Baudisch, P., and Smith, M. Stitching: pen gestures that span multiple displays. Proc. ACM AVI 2004, 23--31.
[18]
Johanson, B., Hutchins, G., Winograd, T., Stone, M. PointRight: Experience with Flexible Input Redirection in Interactive Workspaces. Proc. UIST 2002, 227--234.
[19]
Kohtake, N., Ohsawa, R., Yonezawa, T., Matsukura,Y. Iway, M. Takashio, K., Tokuda, H. u-Texture: Self-Organizable Universal Panels for Creating Smart Surroundings. Proc. UbiComp 2005, 19--36.
[20]
Myers, B.A., Peck, C.H., Nichols, J., Kong, D., and Miller, R. Interacting at a Distance Using Semantic Snarfing. Proc. UbiComp 2001, 305--314.
[21]
Myers, B.A., R. Bhatnagar, J. Nichols, C. H. Peck, D. Kong, R. Miller, and A. C. Long. Interacting At a Distance: Measuring the Performance of Laser Pointers and Other Devices. Proc. CHI 2002, 33--40.
[22]
Nacenta, M., Aliakseyeu, D., Subramanian, S., and Gutwin, C. A Comparison of Techniques for Multi-Display Reaching. Proc. CHI 2005, 371--380.
[23]
Nacenta, M. Computer Vision approaches to solve the screen pose acquisition problem for Perspective Cursor. Tech. Rep. HCI-TR-06-01, Comp. Sci. Dept., U. of Saskatchewan, (2006).
[24]
Olsen Jr., D.R. and Nielsen, T. Laser Pointer Interaction. Proc. CHI 2001, 17--22.
[25]
Parker, J. K., Mandryk, R. L, Inkpen, K. M. TractorBeam: Seamless Integration of Local and Remote Pointing for Tabletop Displays. Proc. Graphics Interface (2005), 33--40.
[26]
Rekimoto, J. Pick-and-Drop A Direct Manipulation Technique for Multiple Computer Environments. Proc. UIST 1997, 31--39.
[27]
Rekimoto, J. and Saitoh, M. Augmented surfaces: a spatially continuous work space for hybrid computing environments. Proc. CHI 1999, 378--385.
[28]
Rekimoto, J., Ayatsuka, Y., and Kohno, M. SyncTap: An interaction technique for mobile networking. Proc. Mobile HCI (2003), 104--115.
[29]
Robertson, G., Czerwinski, M., Baudisch, P., Meyers, B., Robbins, D., Smith, G., and Tan, D. The Large-Display User Experience. IEEE CG&A, 25, 4, (2005), 44--51.
[30]
Román, M., Hess, C., Cerqueira, R., Ranganathan, A., Campbell, R. H., and Nahrstedt, K. A Middleware Infrastructure for Active Spaces. IEEE Pervasive Computing, 1, 4 (2002), 74--83.
[31]
Streitz, N.A., Geißler, J., Holmer, T., Konomi, S., Müller-Tomfelde, C., Reischl, W., Rexroth, P., Seitz, P., and Steinmetz, R. i-LAND: An interactive Landscape for Creativitiy and Innovation. Proc. CHI 1999, 120--127.
[32]
Swaminathan, K. and Sato, S. Interaction design for large displays. Interactions, 4, 1, January 1997, 15--24.
[33]
Wu, M. and Balakrishnan, R. Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. Proc. UIST '2003, 193--202.
[34]
Yee, K.P. Peephole Displays: Pen Interaction on Spatially Aware Handheld Computers. Proc. CHI 2003, 1--8.
[35]
Zhai, S., Morimoto, C., Ihde, S. Manual and Gaze Input Cascaded (MAGIC) Pointing. Proc. CHI 1999, 246--253.

Cited By

View all
  • (2024)VisTorch: Interacting with Situated Visualizations using Handheld ProjectorsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642857(1-13)Online publication date: 11-May-2024
  • (2024)SwitchSpace: Understanding Context-Aware Peeking Between VR and Desktop InterfacesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642358(1-16)Online publication date: 11-May-2024
  • (2023)WAMS: A Flexible API for Visual Workspaces Across Multiple SurfacesProceedings of the ACM on Human-Computer Interaction10.1145/35932367:EICS(1-40)Online publication date: 19-Jun-2023
  • Show More Cited By

Index Terms

  1. Perspective cursor: perspective-based interaction for multi-display environments

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
    April 2006
    1353 pages
    ISBN:1595933727
    DOI:10.1145/1124772
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 22 April 2006

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. direct-manipulation interfaces
    2. laser pointing
    3. multi-display interaction techniques
    4. multi-monitor environments

    Qualifiers

    • Article

    Conference

    CHI06
    Sponsor:
    CHI06: CHI 2006 Conference on Human Factors in Computing Systems
    April 22 - 27, 2006
    Québec, Montréal, Canada

    Acceptance Rates

    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)69
    • Downloads (Last 6 weeks)10
    Reflects downloads up to 15 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)VisTorch: Interacting with Situated Visualizations using Handheld ProjectorsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642857(1-13)Online publication date: 11-May-2024
    • (2024)SwitchSpace: Understanding Context-Aware Peeking Between VR and Desktop InterfacesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642358(1-16)Online publication date: 11-May-2024
    • (2023)WAMS: A Flexible API for Visual Workspaces Across Multiple SurfacesProceedings of the ACM on Human-Computer Interaction10.1145/35932367:EICS(1-40)Online publication date: 19-Jun-2023
    • (2023)Perspective and Geometry Approaches to Mouse Cursor Control in Spatial Augmented RealityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580849(1-19)Online publication date: 19-Apr-2023
    • (2023)Challenges and Opportunities for Multi-Device Management in ClassroomsACM Transactions on Computer-Human Interaction10.1145/351902529:6(1-27)Online publication date: 11-Jan-2023
    • (2023)Comparing Gaze, Head and Controller Selection of Dynamically Revealed Targets in Head-Mounted DisplaysIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332023529:11(4740-4750)Online publication date: 1-Nov-2023
    • (2022)Pull Gestures with Coordinated Graphics on Dual-Screen DevicesProceedings of the 2022 International Conference on Multimodal Interaction10.1145/3536221.3556620(270-277)Online publication date: 7-Nov-2022
    • (2022)Understanding Multi-Device Usage Patterns: Physical Device Configurations and Fragmented WorkflowsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517702(1-22)Online publication date: 29-Apr-2022
    • (2022)In-Depth Mouse: Integrating Desktop Mouse into Virtual RealityProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501884(1-17)Online publication date: 29-Apr-2022
    • (2022)Everywhere Cursor: Extending Desktop Mouse Interaction into Spatial Augmented RealityExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519796(1-7)Online publication date: 27-Apr-2022
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media