research-article

How training and experience affect the benefits of autonomy in a dirty-bomb experiment

Authors:

David J. Bruemmer,

Curtis W. Nielsen,

David I. GertmanAuthors Info & Claims

HRI '08: Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction

Pages 161 - 168

https://doi.org/10.1145/1349822.1349844

Published: 12 March 2008 Publication History

Get Access

Abstract

A dirty-bomb experiment conducted at the INL is used to evaluate the effectiveness and suitability of three different modes of robot control. The experiment uses three distinct user groups to understand how participants' background and training affect the way in which they use and benefit from autonomy. The results show that the target mode, which involves automated mapping and plume tracing together with a point and click tasking tool, provides the best performance for each group. This is true for objective performance such as source detection and localization accuracy as well as subjective measures such as perceived workload, frustration and preference. The best overall performance is achieved by the Explosive Ordinance Disposal group which has experience in both robot teleoperation and dirty bomb response. The user group that benefits least from autonomy is the Nuclear Engineers that have no experience with either robot operation or dirty bomb response. The group that benefits most from autonomy is the Weapons of Mass Destruction Civil Support Team that has extensive experience related to the task, but no robot training.

References

[1]

J. D. Bransford, A. L. Brown, and R. Cocking (eds.). How People Learning: Brain, Mind, Experience, and School. Committee on Developments in the Science of Learning, National Research Council, 1999. http://www.nap.edu/html/howpeople1/

Google Scholar

[2]

D. J. Bruemmer, D. A. Few, R. L. Boring, J. L. Marble, M. C. Walton, and C. W. Nielsen. "Shared Understanding for Collaborative Control." IEEE Transactions on Systems, Man, and Cybernetics, Part A. Systems and Humans, vol. 35, no.4, pp. 505--512, Jul. 2005.

Digital Library

Google Scholar

[3]

D. J. Bruemmer, D. I. Gertman, C. W. Nielsen, D. A. Few, W. D. Smart. "Supporting Complex Robot Behaviors with Simple Interaction Tools." Accepted for publication in Human Robot Interaction, ed. Nilanjan Sarkar, by Advanced Robotics Systems International, Vienna, Austria. 2007.

Google Scholar

[4]

J. L. Burke, R. R. Murphy, E. Rogers, V. J. Lumelsky, and J.Scholtz, "Final report for the DARPA/NSF interdisciplinary study on human-robot interaction," IEEE Trans. Syst., Man, Cybern. C, Appl.Rev., vol. 34, no. 2, pp. 103--112, May 2004

Digital Library

Google Scholar

[5]

K. Konolige. Large-scale map-making. In Proceedings of the National Conference on AI (AAAI), San Jose, CA, 2004.

Digital Library

Google Scholar

[6]

M. LaFrance. "The quality of expertise: implications of expert-novice differences for knowledge acquisition," ACM SIGART Bulletin, vol. 108 pp. 6--14, 1989.

Digital Library

Google Scholar

[7]

J. L. Marble, D. J. Bruemmer, D. A. Few. "Mixed-Initiative Control for Remote Characterization of Hazardous Environments," In Proc. of the 2004 Hawaii International Conference on System Sciences (HICSS), Waikoloa Village, Hawaii, January 2004.

Digital Library

Google Scholar

[8]

C. W. Nielsen and M. A. Goodrich. Comparing the usefulness of video and map information in navigation tasks. In Proceedings of the 2006 Human-Robot Interaction Conference, Salt Lake City, UT, March 2006.

Digital Library

Google Scholar

[9]

C. W. Nielsen and D. J. Bruemmer. "Hiding the system from the user: Moving from complex mental models to elegant metaphors," In Proc. of the IEEE International Symposium on Robot and Human Interactive Communication (Ro--man), Jeju Island, South Korea, August 2007.

Google Scholar

[10]

J. Scholtz, "Human-robot interactions: Creating synergistic cyber forces," in Proc. Workshop Multi-Robot Syst., 2002, pp. 177--184.

Google Scholar

[11]

B. Sellner, F. W. Heger, L. M. Hiatt, R. Simmons, and S. Singh, "Coordinated Multiagent Teams and Sliding Autonomy for Large-Scale Assembly,"Proceedings of the IEEE - Special Issue on Multi-Robot Systems, Vol. 94, No. 7, July, 2006, pp. 1425--1444.

Crossref

Google Scholar

[12]

H. A. Yanco, J. L. Drury, and J. Scholtz, "Beyond usability evaluation: Analysis of human-robot interaction at a major robotics competition," J. Human-Comput. Interaction, vol. 19, pp. 117--149, 2004.

Digital Library

Google Scholar

[13]

B.J. Zimmerman and D. H. Schunk. (Eds.). Self-regulated Learning and Academic Achievement: Theoretical Perspectives (2nd ed.). Mahwah, NJ: Erlbaum. 2001.

Google Scholar

Cited By

View all

Lee HCheon ELim CFischer K(2022)Configuring Humans: What Roles Humans Play in HRI Research2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889496(478-492)Online publication date: 7-Mar-2022
https://doi.org/10.1109/HRI53351.2022.9889496
Tamura YAmano HOta J(2021)Analysis of cognitive skill in a water discharge activity for firefighting robotsROBOMECH Journal10.1186/s40648-021-00201-98:1Online publication date: 14-Apr-2021
https://doi.org/10.1186/s40648-021-00201-9
Tamura YAmano HOta J(2020)Analysis of firefighting skill with a teleoperated robotROBOMECH Journal10.1186/s40648-020-00177-y7:1Online publication date: 20-Jun-2020
https://doi.org/10.1186/s40648-020-00177-y
Show More Cited By

Index Terms

How training and experience affect the benefits of autonomy in a dirty-bomb experiment
1. Computer systems organization
  1. Embedded and cyber-physical systems
    1. Robotics
      1. External interfaces for robotics
      2. Robotic autonomy
    2. Sensors and actuators

Recommendations

Autonomy, Embodiment, and Obedience to Robots
HRI'15 Extended Abstracts: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts

We conducted an HRI obedience experiment comparing an autonomous robotic authority to: (i) a remote-controlled robot, and (ii) robots of variant embodiments during a deterrent task. The results suggest that half of people will continue to perform a ...
Dynamic robot autonomy: investigating the effects of robot decision-making in a human-robot team task
ICMI-MLMI '09: Proceedings of the 2009 international conference on Multimodal interfaces

Robot autonomy is of high relevance for HRI, in particular for interactions of humans and robots in mixed human-robot teams. In this paper, we investigate empirically the extent to which autonomy based on independent decision making and acting by the ...
Autonomy and Common Ground in Human-Robot Interaction: A Field Study

In a two-year study of a collaborative human-robot system, researchers observed a science team in Pittsburgh and a robot in Chile.The system was part of a project intended to inform planetary exploration while studying a terrestrial desert. Over two ...

Comments

Information & Contributors

Information

Published In

HRI '08: Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction

March 2008

402 pages

ISBN:9781605580173

DOI:10.1145/1349822

General Chairs:
Terry Fong
NASA Ames Research Center, USA
,
Kerstin Dautenhahn
University of Hertfordshire, UK
,
Program Chairs:
Matthias Scheutz
Indiana University Bloomington, USA
,
Yiannis Demiris
Imperial College London, UK

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 March 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HRI '08

Sponsor:

HRI '08: International Conference on Human Robot Interaction

March 12 - 15, 2008

Amsterdam, The Netherlands

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
413
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Lee HCheon ELim CFischer K(2022)Configuring Humans: What Roles Humans Play in HRI Research2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889496(478-492)Online publication date: 7-Mar-2022
https://doi.org/10.1109/HRI53351.2022.9889496
Tamura YAmano HOta J(2021)Analysis of cognitive skill in a water discharge activity for firefighting robotsROBOMECH Journal10.1186/s40648-021-00201-98:1Online publication date: 14-Apr-2021
https://doi.org/10.1186/s40648-021-00201-9
Tamura YAmano HOta J(2020)Analysis of firefighting skill with a teleoperated robotROBOMECH Journal10.1186/s40648-020-00177-y7:1Online publication date: 20-Jun-2020
https://doi.org/10.1186/s40648-020-00177-y
Chiou MTalha MStolkinl R(2019)Learning effects in variable autonomy human-robot systems: how much training is enough?2019 IEEE International Conference on Systems, Man and Cybernetics (SMC)10.1109/SMC.2019.8914558(720-727)Online publication date: Oct-2019
https://doi.org/10.1109/SMC.2019.8914558
Chiou MStolkin RBieksaite GHawes NShapiro KHarrison T(2016)Experimental analysis of a variable autonomy framework for controlling a remotely operating mobile robot2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS.2016.7759527(3581-3588)Online publication date: Oct-2016
https://doi.org/10.1109/IROS.2016.7759527
Chiou MHawes NStolkin RShapiro KKerlin JClouter A(2015)Towards the Principled Study of Variable Autonomy in Mobile Robots2015 IEEE International Conference on Systems, Man, and Cybernetics10.1109/SMC.2015.190(1053-1059)Online publication date: Oct-2015
https://doi.org/10.1109/SMC.2015.190
Netland ØJenssen GSkavhaug A(2015)The Capabilities and Effectiveness of Remote Inspection of Wind TurbinesEnergy Procedia10.1016/j.egypro.2015.11.42080(177-184)Online publication date: 2015
https://doi.org/10.1016/j.egypro.2015.11.420
Goodrich MCrandall JBarakova E(2013)Teleoperation and Beyond for Assistive Humanoid RobotsReviews of Human Factors and Ergonomics10.1177/1557234X135024639:1(175-226)Online publication date: 23-Dec-2013
https://doi.org/10.1177/1557234X13502463
Netland ØJenssen GSchade HSkavhaug A(2013)An Experiment on the Effectiveness of Remote, Robotic Inspection Compared to MannedProceedings of the 2013 IEEE International Conference on Systems, Man, and Cybernetics10.1109/SMC.2013.395(2310-2315)Online publication date: 13-Oct-2013
https://dl.acm.org/doi/10.1109/SMC.2013.395
Pratt KMurphy R(2012)Protection from Human Error: Guarded Motion Methodologies for Mobile RobotsIEEE Robotics & Automation Magazine10.1109/MRA.2012.222050019:4(36-47)Online publication date: Dec-2012
https://doi.org/10.1109/MRA.2012.2220500
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Autonomy, Embodiment, and Obedience to Robots

Dynamic robot autonomy: investigating the effects of robot decision-making in a human-robot team task

Autonomy and Common Ground in Human-Robot Interaction: A Field Study

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations