ABSTRACT
We present a virtual reality platform which addresses and integrates some of the currently challenging research topics in the field of virtual assembly: realistic and practical scenarios with several complex geometries, bimanual six-DoF haptic interaction for hands and arms, and intuitive navigation in large workspaces. We put an especial focus on our collision computation framework, which is able to display stiff and stable forces in 1 kHz using a combination of penalty- and constraint-based haptic rendering methods. Interaction with multiple arbitrary geometries is supported in realtime simulations, as well as several interfaces, allowing for collaborative training experiences. Performance results for an exemplary car assembly sequence which show the readiness of the system are provided.
Supplemental Material
- Al-Ahmari, A. M., Abidi, M. H., Ahmad, A., and Darmoul, S. 2016. Development of a virtual manufacturing assembly simulation system. Advances in Mechanical Engineering 8, 3.Google ScholarCross Ref
- Barbič, J., and James, D. L. 2008. Six-dof haptic rendering of contact between geometrically complex reduced deformable models. IEEE Trans. on Haptics 1, 1, 39--52. Google ScholarDigital Library
- Bowman, D. A., and Hodges, L. F. 1999. Formalizing the design, evaluation, and application of interaction techniques for immersive virtual environments. J. of Visual Languages & Computing 10, 1, 37--53.Google ScholarCross Ref
- Cohen, J. D., Lin, M. C., Manocha, D., and Ponamgi, M. 1995. I-collide: An interactive and exact collision detection system for large-scale environments. In Proc. of ACM Interactive 3D Graphics Conference, ACM, 189--ff. Google ScholarDigital Library
- Colgate, J. E., Stanley, M. C., and Brown, J. M. 1995. Issues in the haptic display of tool use. In Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), vol. 3, 140--145.Google Scholar
- Conti, F., and Khatib, O. 2005. Spanning large workspaces using small haptic devices. In Proc. IEEE World Haptics Conference, IEEE, 183--188. Google ScholarDigital Library
- Dominjon, L., Anatole, L., Burkhardt, J.-M., and Simon, R. 2006. A Comparison of Three Techniques to Interact in Large Virtual Environments Using Haptic Devices with Limited Workspace. J. of Material Forming 4035, 288--299. Google ScholarDigital Library
- Garbaya, S., and Zaldivar-Colado, U. 2007. The affect of contact force sensations on user performance in virtual assembly tasks. Virtual Reality 11, 4, 287--299.Google ScholarDigital Library
- Gomes de Sá, A., and Zachmann, G. 1999. Virtual reality as a tool for verification of assembly and maintenance processes. Computers and Graphics 23, 3, 389--403.Google ScholarCross Ref
- Gonzalez-Badillo, G., Medellin-Castillo, H., Lim, T., Ritchie, J., and Garbaya, S. 2014. The development of a physics and constraint-based haptic virtual assembly system. Assembly Automation 34, 1, 41--55.Google ScholarCross Ref
- Gutiérrez, T., Rodríguez, J., Velaz, Y., Casado, S., Suescun, A., and Sánchez, E. J. 2010. Ima-vr: a multimodal virtual training system for skills transfer in industrial maintenance and assembly tasks. In Proc. IEEE Int. Symp. on Robots and Human Interactive Communications (ROMAN), IEEE, 428--433.Google Scholar
- Howard, B. M., and Vance, J. M. 2007. Desktop haptic virtual assembly using physically based modelling. Virtual Reality 11, 4, 207--215.Google ScholarDigital Library
- Hulin, T., Hertkorn, K., Kremer, P., Schätzle, S., Artigas, J., Sagardia, M., Zacharias, F., and Preusche, C. 2011. The dlr bimanual haptic device with optimized workspace (video). In Proc. IEEE Int. Conf. on Robotics and Automation (ICRA), IEEE, 3441--3442.Google Scholar
- Iglesias, R., Casado, S., Gutierrez, T., Garcia-Alonso, A., Yap, K. M., Yu, W., and Marshall, A. 2006. A peer-to-peer architecture for collaborative haptic assembly. In Proc. IEEE Int. Symp. on Distributed Simulation and Real-Time Applications, IEEE, 25--34. Google ScholarDigital Library
- LaViola Jr, J. J. 2000. A discussion of cybersickness in virtual environments. ACM SIGCHI Bulletin 32, 1, 47--56. Google ScholarDigital Library
- Lim, T., Ritchie, J. M., Dewar, R. G., Corney, J. R., Wilkinson, P., Calis, M., Desmulliez, M., and Fang, J.-J. 2007. Factors affecting user performance in haptic assembly. Virtual Reality 11, 4, 241--252.Google ScholarDigital Library
- Liu, K., Yin, X., Fan, X., and He, Q. 2015. Virtual assembly with physical information: a review. Assembly Automation 35, 3, 206--220.Google ScholarDigital Library
- McNeely, W. A., Puterbaugh, K. D., and Troy, J. J. 1999. Six degree-of-freedom haptic rendering using voxel sampling. In Proc. ACM SIGGRAPH, ACM, 401--408. Google ScholarDigital Library
- McNeely, W. A., Puterbaugh, K. D., and Troy, J. J. 2006. Voxel-based 6-dof haptic rendering improvements. Haptics-e: The Electronic Journal of Haptics Research 3, 7, 1--12.Google Scholar
- Mirtich, B., and Canny, J. 1994. Impulse-based dynamic simulation. Tech. rep., University of California at Berkeley. Google ScholarDigital Library
- Ortega, M., Redon, S., and Coquillart, S. 2007. A six degree-of-freedom god-object method for haptic display of rigid bodies with surface properties. IEEE Trans. on Visualization and Computer Graphics 13, 3, 458--469. Google ScholarDigital Library
- Pavlik, R. A., and Vance, J. M. 2011. Expanding haptic workspace for coupled-object manipulation. In Proc. World Conf. on Innovative Virtual Reality (ASME), American Society of Mechanical Engineers (ASME), 293--299.Google Scholar
- Sagardia, M., and Hulin, T. 2016. A fast and robust six-dof god object heuristic for haptic rendering of complex models with friction. In Proc. ACM Symp. on Virtual Reality and Software Techonology (VRST), ACM. (Accepted and pending for publication). Google ScholarDigital Library
- Sagardia, M., Weber, B., Hulin, T., Preusche, C., and Hirzinger, G. 2012. Evaluation of visual and force feedback in virtual assembly verifications. In Proc. IEEE Virtual Reality (VR), IEEE, 23--26. Google ScholarDigital Library
- Sagardia, M., Stouraitis, T., and e Silva, J. L. 2014. A New Fast and Robust Collision Detection and Force Computation Algorithm Applied to the Physics Engine Bullet: Method, Integration, and Evaluation. In EuroVR: Conf. and Exhibition of the European Association of Virtual and Augmented Reality, Eurographics Association, 65--76.Google Scholar
- Sagardia, M., Hertkorn, K., Hulin, T., Schatzle, S., Wolff, R., Hummel, J., Dodiya, J., and Gerndt, A. 2015. VR-OOS: The DLR's virtual reality simulator for telerobotic on-orbit servicing with haptic feedback. In Proc. IEEE Aerospace Conf., 1--17.Google Scholar
- Salisbury, K., and Tarr, C. 1997. Haptic rendering of surfaces defined by implicit functions. In Proc. Annual ASME Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, vol. 61, 61--67.Google Scholar
- Salisbury, K., Conti, F., and Barbagli, F. 2004. Haptic rendering: Introductory concepts. IEEE Computer Graphics and Applications 24, 2, 24--32. Google ScholarDigital Library
- Schätzle, S., Ende, T., Wuesthoff, T., and Preusche, C. 2010. VibroTac: an ergonomic and versatile usable vibrotactile feedback device. In Proc. IEEE Int. Symp. on Robots and Human Interactive Communications (ROMAN), 705--710.Google Scholar
- Seth, A., Su, H.-J., and Vance, J. M. 2006. Sharp: a system for haptic assembly and realistic prototyping. In Proc. ASME Int. Design Engineering Technical Conf. and Computers and Information in Engineering Conf., American Society of Mechanical Engineers (ASME), 905--912.Google Scholar
- Seth, A., Vance, J. M., and Oliver, J. H. 2011. Virtual reality for assembly methods prototyping: a review. Virtual Reality 15, 1, 5--20. Google ScholarDigital Library
- Srinivasan, M. A., and Basdogan, C. 1997. Haptics in virtual environments: Taxonomy, research status, and challenges. Computers & Graphics 21, 4, 393--404.Google Scholar
- Sung, R. C., Corney, J. R., and Clark, D. E. 2001. Automatic assembly feature recognition and disassembly sequence generation. Journal of Computing and Information Science in Engineering 1, 4, 291--299.Google ScholarCross Ref
- Talvas, A., Marchal, M., and Lecuyer, A. 2014. A survey on bimanual haptic interaction. IEEE Trans. on Haptics 7, 3, 285--300.Google ScholarCross Ref
- Tan, H. Z., Srinivasan, M. A., Eberman, B., and Cheng, B. 1994. Human factors for the design of force-reflecting haptic interfaces. Dynamic Systems and Control 55, 1, 353--359.Google Scholar
- Tching, L., Dumont, G., and Perret, J. 2010. Interactive simulation of cad models assemblies using virtual constraint guidance. Int. J. on Interactive Design and Manufacturing (IJIDeM) 4, 2, 95--102.Google ScholarCross Ref
- Wan, H., Gao, S., Peng, Q., Dai, G., and Zhang, F. 2004. Mivas: a multi-modal immersive virtual assembly system. In Proc. Int. Design Engineering Technical Conf. (ASME), American Society of Mechanical Engineers (ASME), 113--122.Google Scholar
- Xia, P., Lopes, A., and Restivo, M. 2011. Design and implementation of a haptic-based virtual assembly system. Assembly Automation 31, 4, 369--384.Google ScholarCross Ref
- Zacharias, F., Howard, I. S., Hulin, T., and Hirzinger, G. 2010. Workspace comparisons of setup configurations for human-robot interaction. In Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), IEEE, 3117--3122.Google Scholar
- Zachmann, G., and Rettig, A. 2001. Natural and robust interaction in virtual assembly simulation. In Proc. Int. Conf. on Concurrent Engineering: Research and Applications (ISPE), vol. 1, 425--434.Google Scholar
- Zorriassatine, F., Wykes, C., Parkin, R., and Gindy, N. 2003. A survey of virtual prototyping techniques for mechanical product development. Proc. of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture 217, 4, 513--530.Google ScholarCross Ref
Index Terms
A platform for bimanual virtual assembly training with haptic feedback in large multi-object environments
Recommendations
A fast and robust Six-DoF god object heuristic for haptic rendering of complex models with friction
VRST '16: Proceedings of the 22nd ACM Conference on Virtual Reality Software and TechnologyCollision detection and force computation between complex geometries are essential technologies for virtual reality and robotic applications. Penalty-based haptic rendering algorithms provide a fast collision computation solution, but they cannot avoid ...
An evaluation of asymmetric interfaces for bimanual virtual assembly with haptics
Immersive computing technology provides a human---computer interface to support natural human interaction with digital data and models. One application for this technology is product assembly methods planning and validation. This paper presents the ...
A Multi-Modal Haptic Interface for Virtual Reality and Robotics
In this paper we present an innovative haptic device that combines the electro-tactile stimulation with the force and visual feedbacks in order to improve the perception of a virtual world. We discuss the sensation evoked in a user by the haptic, force, ...
Comments