Nishant Bugalia
ABSTRACT
In various modern day situations, controlling a robot from a remote location is essential due to hazardous environmental conditions (for human operators) near the robot. Thus arises the need for an intuitive user interface for tele-operation, which must be efficient as well as easy to use. In this paper we present an innovative user interface and overall framework for robotic tele-operation and demonstrate its application to simple bin-picking and hole-packing tasks. We have adopted technologies from Virtual Reality (VR) systems for environment mapping and used modern interface devices to provide haptic feedback.
The user interface of our framework renders a virtual replica of the remote site in which the virtual objects are animated based on the tracking information received from cameras and robot placed at the remote location. A haptic device is used by the human operator to control the remote robotic arm while simultaneously aided by the haptic feedback received from the robotic arm. A tele-operation system using our framework is developed in laboratory environment and the usability of our system is verified by a user survey.
- Background subtraction. http://en.wikipedia.org/wiki/Background_subtraction.Google Scholar
- Fiducial marker. http://en.wikipedia.org/wiki/Fiducial_marker.Google Scholar
- Phantom omni haptic device. http://www.dentsable.com/haptic-phantom-omni.htm.Google Scholar
- L. Basañez Villaluenga, J. Rosell Gratacòs, L. Palomo Avellaneda, E. Nuño Ortega, H. Portilla Rodríguez, et al. A framework for robotized teleoperated tasks. 2011.Google Scholar
- D. Eberly. Least squares fitting of data.Google Scholar
- R. Hartley and A. Zisserman. Multiple view geometry in computer vision. Cambridge university press, 2003. Google ScholarDigital Library
- KUAK. Kr 5 arc - industrial manipulator. http://www.kuka-robotics.com/.Google Scholar
- A. Kushal, V. Bansal, and S. Banerjee. A simple method for interactive 3d reconstruction, camera calibration from a single view. In ICVGIP, 2002.Google Scholar
- F. L. Lewis, C. T. Abdallah, and D. M. Dawson. Control of robot manipulators, volume 236. Macmillan New York, 1993. Google ScholarDigital Library
- S. Lichiardopol. A survey on teleoperation. University of Eindhoven, Department Mechanical Engineering Dynamics and Control Group Eindhoven, 2007.Google Scholar
- R. Munoz-Salinas. Aruco: a minimal library for augmented reality applications based on opencv, 2012.Google Scholar
- O. Networks. What is network latency and why does it matter?Google Scholar
- OpenGL. Opengl is the premier environment for developing portable, interactive 2d and 3d graphics applications. https://www.opengl.org/.Google Scholar
- T. Xie, L. Xie, L. He, and Y. Zheng. A general framework of augmented reality aided teleoperation guidance. Journal of Information and Computational Science, 10(5):1325--1335, 2013.Google ScholarCross Ref
- Immersive environment for robotic tele-operation
Recommendations
Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and TechnologyIn this paper, we present Haptic Around, a hybrid-haptic feedback system, which utilizes fan, hot air blower, mist creator and heat light to recreate multiple tactile sensations in virtual reality for enhancing the immersive environment and interaction. ...
DICE: Digital Immersive Cultural Environment
Digital Heritage. Progress in Cultural Heritage: Documentation, Preservation, and ProtectionAbstractA Digital Immersive Cultural Environment (DICE) consists of a VR/AR (virtual & augmented reality) platform, a CMS (Content Management System) and a GIS (Geographic Information System) for geo-referencing both space and content and for providing ...
The Vicarios Virtual Reality Interface for Remote Robotic Teleoperation: Teleporting for Intuitive Tele-manipulation
AbstractIntuitive interaction is the cornerstone of accurate and effective performance in remote robotic teleoperation. It requires high-fidelity in control actions as well as perception (vision, haptic, and other sensory feedback) of the remote ...
Comments