Informing Digital Cognitive Aids Design for Emergency Medical Work by Understanding Paper Checklist Use

ABSTRACT

We examine the use of a paper-based checklist during 48 simulated trauma resuscitations to inform the design of digital cognitive aids for safety-critical medical teamwork. Our analysis focused on team communication and interaction behaviors as physician leaders led resuscitations and administered the checklist. We found that the checklist increased the amount of communication between the leader and the team, but did not compromise the leader's interactions with the environment. In addition, we observed several changes in team dynamics: the checklist facilitated collaborative decision making and process reflections, but it also made some team members reactive rather than proactive. As the push toward digitizing medical work continues, we expect that paper checklists will soon be replaced by their digital counterparts. Designing interactive cognitive aids for medical domains, however, poses many challenges. Our results offer directions for how these tools could be designed to support medical work in increasingly digital environments.

References

1. Berg, M. and Bowker, G. The multiple bodies of the medical record. The Sociological Quarterly 38, 3 (1997), 513--537.
2. Cabitza, F., Sarini, M., Simone, C., and Telaro, M. When once is not enough: the role of redundancy in a hospital ward setting. Proc. Group 2005, ACM Press (2005), 158--167.
3. Carter, E. A., et al. Adherence to ATLS primary and secondary surveys during pediatric trauma resuscitation. Resuscitation 84, 1 (2012), 66--71.
4. Chen, Y. Documenting transitional information in EMR. Proc. CHI 2010, ACM Press (2010), 1787--1796.
5. Chisholm, C. D., Collison, E. K., Nelson, D. R., and Cordell, W. H. Emergency department workplace interruptions: are emergency physicians "interrupt-driven" and "multitasking"? Academic Emergency Medicine 7, 11 (2000), 1239--1243.
6. Chua, R. V, Cordell, W. H, Ernsting, K. L, Bock, H. C, and Nyhuis AW. Accuracy of bar codes versus handwriting for recording trauma resuscitation events. Annals of Emergency Medicine 22, 10 (1993), 1545--1550.
7. Chua, W. C., D'Amours, S. K., Sugrue, M., Caldwell, E., and Brown, K. Performance and consistency of care in admitted trauma patients. ANZ Journal of Surgery 79, 6 (2009), 443--448.
8. Ellis, C. A., Gibbs, S. J., and Rein, G. L. Groupware: Some issues and experiences. Communications of the ACM 34, 1 (1991), 39--58.
9. Fitzpatrick, G. Integrated care and the working record. Health Informatics Journal 40, 4 (2004), 291--302.
10. Gawande, A. The Checklist Manifesto: How to Get Things Right. Metropolitan Books, New York, NY, USA, 2009.
11. Gertner, A. S., Webber, B. L., and Clarke, J. R. Upholding the maxim of relevance during patient-centered activities, Proc. ANLC 1994, ACM Press (1994), 125--131.
12. Hales, B., Terblanche, M., Fowler, R., and Sibbald, W. Development of medical checklists for improved quality of patient care. International Journal for Quality in Health Care 20, 1 (2008), 22--30.
13. Hart, E. M. and Owen, H. Errors and omissions in anesthesia: A pilot study using a pilot's checklist. Anesthesia & Analgesia 101, 1 (2005), 246--250.
14. Heath, C. and Luff, P. Documents and professional practice: 'bad' organisational reasons for 'good' clinical records. Proc. CSCW 1996, ACM Press (1996), 354--363.
15. Landis, J. and Koch, G. G. The measurement of observer agreement for categorical data. Biometrics 33, (1977) 159--174.
16. Lingard, L., et al. Getting teams to talk: Development and pilot implementation of a checklist to promote inter-professional communication in the OR. Quality and Safety in Health Care 14, 5 (2005), 340--346.
17. Parsons, S., et al. Improving ATLS performance in simulated pediatric trauma resuscitation using a checklist. Annals of Surgery 259, 4 (2014), 807--813.
18. Pronovost, P. J., Goeschel, C. A., Colantuoni, E., Watson, S., Lubomski, L. H., Berenholtz, S. M., and Needham, D. Sustaining reductions in catheter related bloodstream infections in Michigan intensive care units. British Medical Journal 340, (2010), c309.
19. Selen, A. and Harper, R. The Myth of the Paperless Office. MIT Press, Cambridge, MA, USA, 2002.
20. Tang, A., Lanir, J., Greenberg, S., and Fels, S. Supporting transitions in work: Informing large display application design by understanding whiteboard use. Proc. GROUP 2009, ACM Press (2009), 149--158.
21. Weick, K. E. and Roberts, K. H. Collective mind in organizations: Heedful interrelating on flight decks. Administrative Science Quarterly 38, 3 (1993), 357--381.
22. Wu, L., Cirimele, J., Card, S., Klemmer, S., Chu, L., and Harrison, K. Maintaining shared mental models in anesthesia crisis care with nurse tablet input and large-screen displays. Adjunct Proc. UIST 2011, ACM Press (2011), 71--72.
23. Wu, L., Cirimele, J., Leach, K., Card, S., Chu, L., Harrison, K. T., and Klemmer, S. R. Supporting crisis response with dynamic procedure aids. Proc. DIS 2014, ACM Press (2014), 315--324.
24. Wurster, L. A., Groner, J. I., and Hoffman, J. Electronic documentation of trauma resuscitations at a Level 1 pediatric trauma center. J. of Trauma Nursing 19, 2 (2012), 76--79.
25. Zhou, X., Ackerman, M., and Zheng, K. Doctors and psychosocial information: Records and reuse in inpatient care. Proc. CHI 2010, ACM Press (2010), 1767--1776.

Index Terms

• Human-centered computing