Effects of the source of advice and decision task on decisions to request expert advice

ABSTRACT

Automation has become a deeply integrated aspect of our everyday activities. Many factors affect whether we rely on and comply with recommendations that we receive, from both human and automated experts. In the present study, participants were presented with advice from either a human or automated expert to complete one of two decision tasks: assigning teams to find human survivors or assigning teams to find and repair oil wells. Participants played 1 of 4 modified versions of the Search and Rescue video game and, on each trial, were asked to choose 3 of 12 locations to which to send search teams. Participants could request advice from a drone or human expert (confederate), depending on the condition to which they were assigned. Participants utilized automation more consistently than the human expert regardless of the decision task. We discuss possible explanations of our results and how they affect design considerations for automation.

References

1. Veronika Alexander, Collin Blinder, and Paul J. Zak. 2018. Why trust an algorithm? Performance, cognition, and neurophysiology. Computers in Human Behavior 89 (Dec. 2018), 279--288.
2. E S Berner and R S Maisiak. 1999. Influence of case and physician characteristics on perceptions of decision support systems. Journal of the American Medical Informatics Association : JAMIA 6, 5 (Sept. 1999), 428--434.
3. Silvia Bonaccio and Reeshad S. Dalal. 2006. Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences. Organizational Behavior and Human Decision Processes 101, 2 (Nov. 2006), 127--151.
4. J. Carlson, D. Carlson, and L. Wadsworth. 1999. On the relationship between DSS design characteristics and ethical decision making. Journal of Managerial Issues 11, 2 (1999), 180--197. http://www.jstor.org/stable/40604264
5. Francesca Gino and Don A. Moore. 2007. Effects of task difficulty on use of advice. Journal of Behavioral Decision Making 20, 1 (2007), 21--35.
6. Nigel Harvey and Ilan Fischer. 1997. Taking advice: Accepting help, improving judgment, and sharing responsibility. Organizational Behavior and Human Decision Processes 70, 2 (1997), 117 -- 133.
7. Nhut T. Ho, Garrett G. Sadler, Lauren C. Hoffmann, Joseph B. Lyons, and Walter W. Johnson. 2017. Trust of a military automated system in an operational context. Military Psychology 29, 6 (Sept. 2017), 524--541.
8. Kevin Anthony Hoff and Masooda Bashir. 2015. Trust in automation: Integrating empirical evidence on factors that influence trust. Human Factors: The Journal of the Human Factors and Ergonomics Society 57, 3 (May 2015), 407--434.
9. Chris Johnson. 2004. Final report: Review of the BFU ÃIJberlingen accident report. Technical Report Contract c/1.369/HQ/SS/04. Glasgow, Scotland, UK.
10. Edgar E. Kausel, Satoris S. Culbertson, Pedro I. Leiva, Jerel E. Slaughter, and Alexander T. Jackson. 2015. Too arrogant for their own good? Why and when narcissists dismiss advice. Organizational Behavior and Human Decision Processes 131 (Nov. 2015), 33--50.
11. Benjamin Kleinmuntz. 1990. Why we still use our heads instead of formulas: Toward an integrative approach. Psychological Bulletin 107, 3 (1990), 296--310.
12. Moritz Körber, Eva Baseler, and Klaus Bengler. 2018. Introduction matters: Manipulating trust in automation and reliance in automated driving. Applied Ergonomics 66 (Jan. 2018), 18--31.
13. John D. Lee and Katrina A. See. 2004. Trust in automation: designing for appropriate reliance. Human Factors: The Journal of the Human Factors and Ergonomics Society 46, 1 (2004), 50--80.
14. Joseph B. Lyons and Charlene K. Stokes. 2012. Human-human reliance in the context of automation. Human Factors: The Journal of the Human Factors and Ergonomics Society 54, 1 (Feb. 2012), 112--121.
15. Poornima Madhavan and Douglas A. Wiegmann. 2007. Effects of information source, pedigree, and reliability on operator interaction with decision support systems. Human Factors: The Journal of the Human Factors and Ergonomics Society 49, 5 (Oct. 2007), 773--785.
16. Roger C. Mayer, James H. Davis, and F. David Schoorman. 1995. An integrative model of organizational trust. The Academy of Management Review 20, 3 (1995), 709--734.
17. Dilek Önkal, Paul Goodwin, Mary Thomson, Sinan Gönül, and Andrew Pollock. 2009. The relative influence of advice from human experts and statistical methods on forecast adjustments. Journal of Behavioral Decision Making 22, 4 (Oct. 2009), 390--409.
18. Raja Parasuraman and Victor Riley. 1997. Humans and automation: Use, misuse, disuse, abuse. Human Factors: The Journal of the Human Factors and Ergonomics Society 39, 2 (June 1997), 230--253.
19. R. Parasuraman, T.B. Sheridan, and C.D. Wickens. 2000. A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans 30, 3 (May 2000), 286--297.
20. Carl J. Pearson and Christopher B. Mayhorn. 2017. The effects of pedigree and source type on trust in a dual adviser context. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 61, 1 (Sept. 2017), 319--323.
21. Carl J. Pearson, Allaire K. Welk, William A. Boettcher, Roger C. Mayer, Sean Streck, Joseph M. Simons-Rudolph, and Christopher B. Mayhorn. 2016. Differences in trust between human and automated decision aids. In Proceedings of the Symposium and Bootcamp on the Science of Security - HotSos '16. ACM Press, Pittsburgh, Pennsylvania, 95--98.
22. Andrew Prahl and Lyn van Swol. 2017. Understanding algorithm aversion: When is advice from automation discounted? Journal of Forecasting 36, 6 (Sept. 2017), 691--702.
23. Kennon M. Sheldon, Andrew J. Elliot, Youngmee Kim, and Tim Kasser. 2001. What is satisfying about satisfying events? Testing 10 candidate psychological needs. Journal of Personality and Social Psychology 80, 2 (2001), 325--339.
24. Steven C. Sutherland, Casper Harteveld, and Michael E. Young. 2016. Effects of the advisor and environment on requesting and complying with automated advice. ACM Transactions on Interactive Intelligent Systems 6, 4 (Nov. 2016), 1--36.
25. Martin A. Tolcott. 1992. Understanding & aiding military decisions. 27th International Appplied Military Psychology Symposium: A Focus on Decision Making Research (Aug. 1992), 33--48.
26. Lyn M. van Swol and Janet A. Sniezek. 2005. Factors affecting the acceptance of expert advice. British Journal of Social Psychology 44, 3 (2005), 443--461.
27. Joshua S. Weitz, Ceyhun Eksin, Keith Paarporn, Sam P. Brown, and William C. Ratcliff. 2016. An oscillating tragedy of the commons in replicator dynamics with game-environment feedback. Proceedings of the National Academy of Sciences 113, 47 (Nov. 2016), E7518--E7525.
28. Ilan Yaniv. 2004. Receiving other people's advice: Influence and benefit. Organizational Behavior and Human Decision Processes 93, 1 (2004), 1 -- 13.
29. Ilan Yaniv and Maxim Milyavsky. 2007. Using advice from multiple sources to revise and improve judgments. Organizational Behavior and Human Decision Processes 103, 1 (May 2007), 104--120.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Empirical studies in HCI

    • HCI theory, concepts and models

• Social and professional topics

  • Professional topics

    • Computing and business

      • Automation