Object deformation and force feedback for virtual chopsticks

ABSTRACT

This paper proposes a virtual chopsticks system using force feedback and object deformation with FEM (finite element model). The force feedback model is established by using a leverage based on the correct chopsticks handling manner, and the force is applied to the index and middle finger. The object deformation is obtained in real-time by calculating inverse stiffness matrix beforehand. We performed experiments to compare the hardness of virtual objects. As a result, we found that a recognition rate of almost 100% can be achieved between virtual objects where the logarithmic difference in hardness is 0.4 or more, while lower recognition rates are obtained when the difference in hardness is smaller than this.

REFERENCES

• 1: D. Zeltzer, S. Pieper and D. Sturman: An integrated graphical simulation platform, Proc. of Graphics Interface '89, pp. 266--274 (1989).
• 2: G. Drew Kessler , Larry F. Hodges , Neff Walker, Evaluation of the CyberGlove as a whole-hand input device, ACM Transactions on Computer-Human Interaction (TOCHI), v.2 n.4, p.263-283, Dec. 1995 [doi>10.1145/212430.212431]
• 3: Zhiyong Huang , Ronan Boulic , Nadia Magnenat Thalmann , Daniel Thalmann, A multi-sensor approach for grasping and 3D interaction, Computer graphics: developments in virtual environments, Academic Press Ltd., London, UK, 1995
• 4: Grigore C. Burdea, Force and touch feedback for virtual reality, John Wiley & Sons, Inc., New York, NY, 1996
• 5: Frederick P. Brooks, Jr. , Ming Ouh-Young , James J. Batter , P. Jerome Kilpatrick, Project GROPEHaptic displays for scientific visualization, ACM SIGGRAPH Computer Graphics, v.24 n.4, p.177-185, Aug. 1990
• 6: Hiroo Iwata, Artificial reality with force-feedback: development of desktop virtual space with compact master manipulator, ACM SIGGRAPH Computer Graphics, v.24 n.4, p.165-170, Aug. 1990
• 7: T. Massie, K. Salisbury: PHANToM haptic interface: a device for probing virtual objects, 1994 Intl. Mech. Eng. Cong. And Expo. Chicago, IL, pp. 1106--1111 (1994).
• 8: Tactile information for heightened reality - using an ultrasonic motor to simulate the reaction force of a barrier, Nikkei Mechanical, No. 474 (1996) (in Japanese).
• 9: Masamichi Sakaguchi , Junji Furusho , Naoyuki Takesue, Passive Force Display Using ER Brakes and its Control Experiments, Proceedings of the Virtual Reality 2001 Conference (VR'01), p.7, March 13-17, 2001
• 10: Li-Te Cheng , Rick Kazman , John Robinson, Vibrotactile feedback in delicate virtual reality operations, Proceedings of the fourth ACM international conference on Multimedia, p.243-251, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244220]
• 11: M. Ishii and M. Sato: A 3D spatial interface device using tensed strings, Presence, Vol. 3, No. 1, pp. 81--86 (1994).
• 12: D. Gomez , G. Burdea , N. Langrana, Integration of the Rutgers Master II in a virtual reality simulation, Proceedings of the Virtual Reality Annual International Symposium (VRAIS'95), p.198, March 11-15, 1995
• 13: M. L. Turner, D. H. Gomez, M. R. Tremblay and M. R. Cutkosky: Preliminary tests of an arm-grounded haptic feedback device in telemanipulation, Proc. of the ASME Dynamic Systems and Control Division, DSC-Vol. 64, pp.145--149 (1998).
• 14: M. A. Srinivasan and R. H. Lamotte: The impact of visual information on the haptic perception of stiffness in virtual environments, Proceedings of the ASME Dynamic Systems and Control Division, DSC-Vol. 58, pp. 555--559 (1996).
• 15: H. Sasaki and K. Fujita: An experimental study of the contributions and changes resulting from visual information in the representation of hardness using force feedback devices, Journal of the Virtual Reality Society of Japan, Vol. 5, No. 1, pp. 795--802 (2000) (in Japanese).
• 16: Shin-ya Miyazaki , Masao Ishiguro , Takami Yasuda , Shigeki Yokoi , Jun-ichiro Toriwaki, A study of virtual manipulation of elastic objects, Computer graphics: developments in virtual environments, Academic Press Ltd., London, UK, 1995
• 17: Rungun Ramanathan , Dimitris Metaxas, Dynamic Deformable Models for Enhanced Haptic Rendering in Virtual Environments, Proceedings of the IEEE Virtual Reality 2000 Conference, p.31, March 18-22, 2000
• 18: K. Hirota and T. Kaneko: Haptic representation of elastic object; Presence, Vol. 10, No. 5, pp. 525--536 (2001).
• 19: Andreas O. Frank , I. Alexander Twombly , Timothy J. Barth , Jeffrey D. Smith, Finite Element Methods for Real-Time Haptic Feedback of Soft-Tissue Models in Virtual Reality Simulators, Proceedings of the Virtual Reality 2001 Conference (VR'01), p.257, March 13-17, 2001
• 20: Yoshifumi Kitamura , Tomohiko Higashi , Toshihiro Masaki , Fumio Kishino, Virtual Chopsticks: Object Manipulation using Multiple Exact Interactions, Proceedings of the IEEE Virtual Reality, p.198, March 13-17, 1999
• 21: K. Fujita: Construction and evaluation of an experimental glove-type device for indicating the hardness of virtual objects, IEICE Journal, Vol. J81-D, No. 10, pp. 2394--2400 (1998) (in Japanese).
• 22: M. Mitchell and J. Corr.: The complete idiot's guide to etiquette. Alpha Books, New York (1996).
• 23: H. Takahashi: Force feedback and precision of NURBS surfaces, Journal of the Virtual Reality Society of Japan, Vol. 3, No. 3, pp. 99--105 (1998) (in Japanese).
• 24: M. Yagawa and S. Yoshimura: Computational Dynamics and CAE series 1 - the Finite Element Method, Baihuukan (1991) (in Japanese).
• 25: Hiroo Iwata , Hiroaki Yano , Takahiro Uemura , Tetsuro Moriya, Food Simulator: A Haptic Interface for Biting, Proceedings of the IEEE Virtual Reality 2004 (VR'04), p.51, March 27-31, 2004 [doi>10.1109/VR.2004.40]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen); Graphical user interfaces (GUI); Haptic I/O

General Terms:
Experimentation, Human Factors

Keywords:
FEM, deformation, force feedback, object manipulation, virtual chopsticks, virtual environment