PRISM interaction for enhancing control in immersive virtual environments

ABSTRACT

When directly manipulating 3D objects in an immersive environment we cannot normally achieve the accuracy and control that we have in the real world. This reduced accuracy stems from hand instability. We present PRISM, which dynamically adjusts the C/D ratio between the hand and the controlled object to provide increased control when moving slowly and direct, unconstrained interaction when moving rapidly. We describe PRISM object translation and rotation and present user studies demonstrating their effectiveness. In addition, we describe a PRISM-enhanced version of ray casting which is shown to increase the speed and accuracy of object selection.

REFERENCES

• 1: Johnny Accot , Shumin Zhai, Beyond Fitts' law: models for trajectory-based HCI tasks, Proceedings of the SIGCHI conference on Human factors in computing systems, p.295-302, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258760]
• 2: Pär-Anders Albinsson , Shumin Zhai, High precision touch screen interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642631]
• 3: Benjamin B. Bederson , Jon Meyer , Lance Good, Jazz: an extensible zoomable user interface graphics toolkit in Java, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.171-180, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354754]
• 4: Eric A. Bier, Snap-dragging in three dimensions, Proceedings of the 1990 symposium on Interactive 3D graphics, p.193-204, February 1990, Snowbird, Utah, United States
• 5: Renaud Blanch , Yves Guiard , Michel Beaudouin-Lafon, Semantic pointing: improving target acquisition with control-display ratio adaptation, Proceedings of the SIGCHI conference on Human factors in computing systems, p.519-526, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985758]
• 6: Doug A. Bowman , Larry F. Hodges, An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments, Proceedings of the 1997 symposium on Interactive 3D graphics, p.35-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253301]
• 7: Doug A. Bowman , Chadwick A. Wingrave, Design and Evaluation of Menu Systems for Immersive Virtual Environments, Proceedings of the Virtual Reality 2001 Conference (VR'01), p.149, March 13-17, 2001
• 8: Bowman, D., Wingrave, C., Campbell, J., and Ly, V. 2001. Using pinch gloves for both natural and abstract interaction techniques in virtual environments. In Proceedings of HCI International. pp. 629--633.
• 9: Richard W. Bukowski , Carlo H. Séquin, Object associations: a simple and practical approach to virtual 3D manipulation, Proceedings of the 1995 symposium on Interactive 3D graphics, p.131-ff., April 09-12, 1995, Monterey, California, United States [doi>10.1145/199404.199427]
• 10: Michael Chen , S. Joy Mountford , Abigail Sellen, A study in interactive 3-D rotation using 2-D control devices, Proceedings of the 15th annual conference on Computer graphics and interactive techniques, p.121-129, June 1988
• 11: Anatole Lecuyer , Jean-Marie Burkhardt, Influence of Color/Display Ratio on the Perception of Mass of Manipulated Objects in Virtual Environments, Proceedings of the 2005 IEEE Conference 2005 on Virtual Reality, p.19-25, 318, March 12-16, 2005 [doi>10.1109/VR.2005.49]
• 12: Fitts, P. M. 1954. The information capacity of the human motor system in controlling the amplitude of movement. J. Exper. Psych. 47, 381--391.
• 13: James D. Foley , Victor L. Wallace , Peggy Chan, The human factors of computer graphics interaction techniques, IEEE Computer Graphics and Applications, v.4 n.11, p.13-48, Nov. 1984
• 14: Scott Frees , G. Drew Kessler, Precise and Rapid Interaction through Scaled Manipulation in Immersive Virtual Environments, Proceedings of the 2005 IEEE Conference 2005 on Virtual Reality, p.99-106, March 12-16, 2005 [doi>10.1109/VR.2005.60]
• 15: D. Gerber , D. Bechmann, The Spin Menu: A Menu System for Virtual Environments, Proceedings of the 2005 IEEE Conference 2005 on Virtual Reality, p.271-272, March 12-16, 2005 [doi>10.1109/VR.2005.81]
• 16: Grosjean, J. and Coquillart, S. 2001. Command & control cube: A shortcut paradigm for virtual environments. In Proceedings of Immersive Projection Technology and Virtual Environments. pp. 1--12.
• 17: Ken Hinckley , Randy Pausch , John C. Goble , Neal F. Kassell, A survey of design issues in spatial input, Proceedings of the 7th annual ACM symposium on User interface software and technology, p.213-222, November 02-04, 1994, Marina del Rey, California, United States [doi>10.1145/192426.192501]
• 18: Ken Hinckley , Randy Pausch , John C. Goble , Neal F. Kassell, Passive real-world interface props for neurosurgical visualization, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.452-458, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191821]
• 19: Ken Hinckley , Joe Tullio , Randy Pausch , Dennis Proffitt , Neal Kassell, Usability analysis of 3D rotation techniques, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.1-10, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263408]
• 20: Takeo Igarashi , Ken Hinckley, Speed-dependent automatic zooming for browsing large documents, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.139-148, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354435]
• 21: Hiroshi Ishii , Brygg Ullmer, Tangible bits: towards seamless interfaces between people, bits and atoms, Proceedings of the SIGCHI conference on Human factors in computing systems, p.234-241, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258715]
• 22: G. Drew Kessler , Doug A. Bowman , Larry F. Hodges, The Simple Virtual Environment Library: An Extensible Framework for Building VE Applications, Presence: Teleoperators and Virtual Environments, v.9 n.2, p.187-208, April 2000 [doi>10.1162/105474600566718]
• 23: Jiandong Liang , Chris Shaw , Mark Green, On temporal-spatial realism in the virtual reality environment, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.19-25, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120784]
• 24: Robert W. Lindeman , John L. Sibert , James K. Hahn, Towards usable VR: an empirical study of user interfaces for immersive virtual environments, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.64-71, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.302995]
• 25: Mapes, D. P. and Moshell, J. M. 1995. A two-handed interface for object manipulation in virtual environments, Presence: Teleoperators and Virtual Environments 4, 4, 403--416.
• 26: Mark R. Mine, Virtual Environment Interaction Techniques, University of North Carolina at Chapel Hill, Chapel Hill, NC, 1995
• 27: Mark R. Mine , Frederick P. Brooks, Jr. , Carlo H. Sequin, Moving objects in space: exploiting proprioception in virtual-environment interaction, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.19-26, August 1997 [doi>10.1145/258734.258747]
• 28: Parsons, L. 1995. Inability to reason about an object's orientation using an axis and angle of rotation. J. Exper. Psych.: Human Percep. Perf. 21, 6, 1259--1277.
• 29: Jeffrey S. Pierce , Andrew S. Forsberg , Matthew J. Conway , Seung Hong , Robert C. Zeleznik , Mark R. Mine, Image plane interaction techniques in 3D immersive environments, Proceedings of the 1997 symposium on Interactive 3D graphics, p.39-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253303]
• 30: Jeffrey S. Pierce , Randy Pausch, Comparing voodoo dolls and HOMER: exploring the importance of feedback in virtual environments, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503396]
• 31: Jeffrey S. Pierce , Brian C. Stearns , Randy Pausch, Voodoo dolls: seamless interaction at multiple scales in virtual environments, Proceedings of the 1999 symposium on Interactive 3D graphics, p.141-145, April 26-29, 1999, Atlanta, Georgia, United States [doi>10.1145/300523.300540]
• 32: Ivan Poupyrev , Mark Billinghurst , Suzanne Weghorst , Tadao Ichikawa, The go-go interaction technique: non-linear mapping for direct manipulation in VR, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.79-80, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237102]
• 33: Ivan Poupyrev , Suzanne Weghorst , Mark Billinghurst , Tadao Ichikawa, A framework and testbed for studying manipulation techniques for immersive VR, Proceedings of the ACM symposium on Virtual reality software and technology, p.21-28, September 1997, Lausanne, Switzerland [doi>10.1145/261135.261141]
• 34: Ivan Poupyrev , Suzanne Weghorst , Sidney Fels, Non-isomorphic 3D rotational techniques, Proceedings of the SIGCHI conference on Human factors in computing systems, p.540-547, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332497]
• 35: Roy A. Ruddle , Justin C. D. Savage , Dylan M. Jones, Evaluating rules of interaction for object manipulation in cluttered virtual environments, Presence: Teleoperators and Virtual Environments, v.11 n.6, p.591-609, December 2002 [doi>10.1162/105474602321050721 ]
• 36: Ken Shoemake, Animating rotation with quaternion curves, Proceedings of the 12th annual conference on Computer graphics and interactive techniques, p.245-254, July 1985
• 37: Ken Shoemake, ARCBALL: a user interface for specifying three-dimensional orientation using a mouse, Proceedings of the conference on Graphics interface '92, p.151-156, September 1992, Vancouver, British Columbia, Canada
• 38: Richard Stoakley , Matthew J. Conway , Randy Pausch, Virtual reality on a WIM: interactive worlds in miniature, Proceedings of the SIGCHI conference on Human factors in computing systems, p.265-272, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223938]
• 39: Wolfgang Stuerzlinger , Graham Smith, Efficient Manipulation of Object Groups in Virtual Environments, Proceedings of the IEEE Virtual Reality Conference 2002, p.251, March 24-28, 2002
• 40: Desney S. Tan , George G. Robertson , Mary Czerwinski, Exploring 3D navigation: combining speed-coupled flying with orbiting, Proceedings of the SIGCHI conference on Human factors in computing systems, p.418-425, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365307]
• 41: C. Ware, Using hand position for virtual object placement, The Visual Computer: International Journal of Computer Graphics, v.6 n.5, p.245-253, 1990 [doi>10.1007/BF01900747]
• 42: Colin Ware , Jeff Rose, Rotating virtual objects with real handles, ACM Transactions on Computer-Human Interaction (TOCHI), v.6 n.2, p.162-180, June 1999 [doi>10.1145/319091.319102]
• 43: Greg Welch , Gary Bishop, SCAAT: incremental tracking with incomplete information, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.333-344, August 1997 [doi>10.1145/258734.258876]
• 44: Shumin Zhai , Paul Milgram , William Buxton, The influence of muscle groups on performance of multiple degree-of-freedom input, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.308-315, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238534]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

General Terms:
Human Factors

Keywords:
3D object manipulation, direct object manipulation, precision manipulation, virtual reality