skip to main content
10.1145/1349822.1349869acmconferencesArticle/Chapter ViewAbstractPublication PageshriConference Proceedingsconference-collections
research-article

Towards multimodal human-robot interaction in large scale virtual environment

Published: 12 March 2008 Publication History

Abstract

Human Operators (HO) of telerobotics systems may be able to achieve complex operations with robots. Designing usable and effective Human-Robot Interaction (HRI) is very challenging for system developers and human factors specialists. The search for new metaphors and techniques for HRI adapted to telerobotics systems emerge on the conception of Multimodal HRI (MHRI). MHRI allows to interact naturally and easily with robots due to combination of many devices and an efficient Multimodal Management System (MMS). A system like this should bring a new user's experience in terms of natural interaction, usability, efficiency and flexibility to HRI system. So, a good management of multimodality is very. Moreover, the MMS must be transparent to user in order to be efficient and natural.
Empirical evaluation is necessary to have an idea about the goodness of our MMS. We will use an Empirical Evaluation Assistant (EEA) designed in the IBISC laboratory. EEA permits to rapidly gather significant feedbacks about the usability of interaction during the development lifecycle. However the HRI would be classically evaluated by ergonomics experts at the end of its development lifecycle.
Results from a preliminary evaluation on a robot teleoperation tasks using the ARITI software framework for assisting the user in piloting the robot, and the IBISC semi-immersive VR/AR platform EVR@, are given. They compare the use of a Flystick and Data Gloves for the 3D interaction with the robot. They show that our MMS is functional although multimodality used in our experiments is not sufficient to provide an efficient Human-Robot Interaction. The EVR@ SPIDAR force feedback will be integrated in our MMS to improve the user's efficiency.

References

[1]
Hasegawa T., Suehiro T., Ogasawara T., Matsui T., Kitagaki K., and Takase K., 1991. Model-based telerobot system manipulation skill. In '91 International Symposiumon Advanced Robot Technology, pp 499--506.
[2]
Espiau B., 1986. Technical report : Téléopération avancée: Le projet de téléopération avancée, Saclay, France. 3, 4, 5 December 1986.
[3]
Otmane, S., Mallem M., Kheddar A. and Chavand F., 2000. ARITI: an augmented reality interface for teleoperation on the Internet. In Advanced Simulation Technologies Conference (ASTC2000), Washington D.C., USA, pp 254--261.
[4]
Ouramdane N., Davesne F., Otmane S. and Mallem M., 2006. FOLLOW-ME: a new 3D interaction technique based on virtual guides and granularity of interaction. In ACM International Conference on Virtual Reality Continuum and Its Applications (VRCIA 2006), Hong Kong, China, pp. 137--144.
[5]
Irawati S., Calderòn D. and Ko H., 2006. Spatial Ontology for Semantic Integration in 3D Multimodal Interaction Framework. In ACM International Conference on Virtual Reality Continuum and Its Applications (VRCIA 2006), Hong Kong, China, pp 129--135.
[6]
Kaiser E., Olwal A., McGee D., Benko H., Corradini A., Li X., Cohen P. and Feiner S., 2003. Mutual Disambiguation of 3D Multimodal Interaction in Augmented and Virtual Reality In ICMI-PUI '03,.
[7]
Sato M., 2002. Development of String-based Force Display: SPIDAR. In 8th International Conference on Virtual Systems and Multimedia, Precision and Intelligence Laboratory, Tokyo Institute of Technology, 4259 Nagatsuta, Midori-ku, Yokohama, 226--8503, Japan.
[8]
Bowman D., Kruijff E., Laviola J. and Poupyrev I, 2001. 3D User Interfaces theory and practice, Edition Addison Wesley, USA.
[9]
Karaseitanidis I., Amditis A., Patelb H., Sharplesb S., Bekiarisa E., Bullingerc A. and Tromp J., 2005. Evaluation of virtual reality products and applications from individual, organizational and societal perspectives: The "VIEW" case study, Int. J. Human-Computer Studies 64, Elsevier Science, pp. 251--266.
[10]
Gabbard J. L., Hix D. and Swan II J. E., 1999. User-Centered Design and Evaluation of Virtual Environments, IEEE Computer Graphics and Applications, USA.

Cited By

View all
  • (2021)Toward Automated Mixed Reality Interface Design: An Evolutionary Optimization ApproachArtificial Intelligence in HCI10.1007/978-3-030-77772-2_35(532-540)Online publication date: 3-Jul-2021
  • (2017)Multimodality Evaluation Metrics for Human-Robot Interaction Needed: A Case Study in Immersive TeleroboticsAdvances in Human Factors in Robots and Unmanned Systems10.1007/978-3-319-60384-1_32(335-347)Online publication date: 21-Jun-2017
  • (2016)Stabilizing control and human scale simulation of a submarine ROV navigationOcean Engineering10.1016/j.oceaneng.2015.12.054114(66-78)Online publication date: Mar-2016
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
HRI '08: Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction
March 2008
402 pages
ISBN:9781605580173
DOI:10.1145/1349822
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 March 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. empirical evaluation
  2. human-robot interaction
  3. multimodal interaction
  4. usability
  5. virtual environment

Qualifiers

  • Research-article

Conference

HRI '08
HRI '08: International Conference on Human Robot Interaction
March 12 - 15, 2008
Amsterdam, The Netherlands

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)13
  • Downloads (Last 6 weeks)1
Reflects downloads up to 31 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2021)Toward Automated Mixed Reality Interface Design: An Evolutionary Optimization ApproachArtificial Intelligence in HCI10.1007/978-3-030-77772-2_35(532-540)Online publication date: 3-Jul-2021
  • (2017)Multimodality Evaluation Metrics for Human-Robot Interaction Needed: A Case Study in Immersive TeleroboticsAdvances in Human Factors in Robots and Unmanned Systems10.1007/978-3-319-60384-1_32(335-347)Online publication date: 21-Jun-2017
  • (2016)Stabilizing control and human scale simulation of a submarine ROV navigationOcean Engineering10.1016/j.oceaneng.2015.12.054114(66-78)Online publication date: Mar-2016
  • (2011)Advanced methods for displays and remote control of robotsApplied Ergonomics10.1016/j.apergo.2011.01.00442:6(820-829)Online publication date: Nov-2011
  • (2010)Towards Collaborative Teleoperation Based on Human‐Scale Networked Mixed Reality EnvironmentsEnd‐to‐End Quality of Service Engineering in Next Generation Heterogenous Networks10.1002/9780470611470.ch15(377-406)Online publication date: 2-Feb-2010
  • (2009)2D and 3D virtual environment for human robot interactionProceedings of the 2009 international conference on Robotics and biomimetics10.5555/1819998.1820137(694-699)Online publication date: 19-Dec-2009
  • (2009)A distributed architecture for collaborative teleoperation using virtual reality and web platformsProceedings of the 6th IEEE Conference on Consumer Communications and Networking Conference10.5555/1700527.1700596(176-180)Online publication date: 11-Jan-2009
  • (2009)2D and 3D virtual environment for human robot interaction: From virtual perception to real localization2009 IEEE International Conference on Robotics and Biomimetics (ROBIO)10.1109/ROBIO.2009.5420590(694-699)Online publication date: Dec-2009
  • (2009)A Distributed Architecture for Collaborative Teleoperation using Virtual Reality and Web Platforms2009 6th IEEE Consumer Communications and Networking Conference10.1109/CCNC.2009.4784826(1-5)Online publication date: Jan-2009
  • (2008)Standardization and Integration in RoboticsProceedings of the 2008 International Conference on Cyberworlds10.1109/CW.2008.106(525-530)Online publication date: 22-Sep-2008

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media