Visual reporting in time-critical work: exploring video use in emergency response

ABSTRACT

This paper reports on an explorative project aimed to study the use of live video technology in emergency response work. The initial stage of the project aimed at enabling an emergency response organization with live video capabilities. The study covered the steps of design, development and deployment of an application for live video broadcasting. Over a 10 months period, professional responders has used the application in over 200 incidents. The study shows how short video sequences are produced as an embedded activity in order to capture small fragments of work rather than creating a complete coverage of an incident. Further, this study also shows how broadcasted video is incorporated into the work at the command center as visual reports, which open up for collective negotiations of the broader meaning of a situation.

References

1. Anderson, A. H., Smallwood, L., MacDonald, R., Mullin, J., Fleming, A., O' Malley, C. (2000). Video data and video links in mediated communication: what do users value?, International Journal of Human-Computer Studies, 52, 1, (2000) p. 165--187
2. Bergstrand, F. and Landgren, J. Information sharing using live video in emergency response work. In Proc. ISCRAM 2009
3. Blomberg, J. L., & Henderson, A. Reflections on participatory design: lessons from the trillium experience. In Proc. CHI 1990, ACM Press (1990), 353--360
4. Camp, P. J., Hudson, J. M., Keldorph, R.. Lewis, S., Mynatt, E. D. Supporting communication and collaboration practices in safety-critical situations. In Proc. CHI 2000, ACM Press (2000), 249--250
5. Calloway, L. J. & Keen. P. G. W. Organizing for crisis response. Journal of Information Technology 11(1), 13--27
6. Dourish, P. and Bly, S. Portholes: supporting awareness in a distributed work group. In Proc. CHI 1992, ACM Press (1992), 541--547
7. Dunn, J. C., Lewandowsky, S., & Kirsner, K. Dynamics of communication in emergency management. Applied Cognitive Psychology (2002), 16(6), 719--737
8. Engström, A., Esbjörnsson, M., and Juhlin, O. 2008. Mobile collaborative live video mixing. In Proc. of MobileHCI '08, ACM Press (2008), 157--166
9. Engström, A., Juhlin, O., Perry, M., and Broth, M. Temporal hybridity: footage with instant replay in real time. In Proc. CHI 2010, ACM Press (2010), p. 1495--1504
10. Gaver, B., Dunne, T., and Pacenti, E. Design: Cultural probes. Interactions 6, 1 (1999), 21--29
11. Gaver, W., Sellen, A., Heath, C. and Luff, P. One is not enough: Multiple views in a media space. In Proc. INTERACT '93, ACM Press (1993), 335--341
12. Heath, C. and Luff, P. Disembodied conduct: communication through video in a multi-media office environment. In Proc. CHI 1991, ACM Press (1991), 99--103
13. Heath, C. and Luff, P. Collaboration and Control: Crisis Management and Multimedia Technology in London Underground Line Control Rooms, Computer Supported Cooperative Work 11(1--2), (1992), 69--95
14. Hindmarsh, J., Fraser, M., Heath, C., Benford, S., and Greenhalgh, C. Fragmented interaction: establishing mutual orientation in virtual environments. In Proc. of CSCW 1998, ACM Press (1998), 217--226
15. Hughes, J. A., D. Randall, D. Shapiro. Faltering from ethnography to design. In Proc. CSCW 1992, ACM Press (1992), 115--122
16. Jiang, X., Hong, JI., Takayama, LA., & Landay, JA. Ubiquitous Computing for Firefighters: Field Studies and Prototypes of Large Displays for Incident Command. In Proc. CHI 2004, ACM Press (2004), 679--686
17. Juhlin, O., Engström, A., & Reponen, E. Mobile Broadcasting --- The Whats and Hows of Live Video as a Social Medium. In Proc. MobileHCI'10, ACM Press (2010), 35--44
18. Kensing, F. Methods and Practices in Participatory Design. ITU-Press (2003), Copenhagen.
19. Kirk, D., Sellen, A., Harper, R., Wood, K. Understanding videowork. In Proc. CHI 2007, ACM Press (2007), 61--70
20. Kraut, R. E., Fussell, S. R., and Siegel, J. Visual information as a conversational resource in collaborative physical tasks. Human-Computer Interaction 18(1), ACM Press (2003), 13--49
21. Kristensen, M., Kyng, M., Palen, L. (2006). Participatory design in emergency medical service: designing for future practice. In Proc. CHI 2006, ACM Press (2006), 161--170
22. Kyng, M., Toftdal Nielsen, E., & Kristensen, M. Challenges in designing interactive systems for emergency response. In Proc. Designing Interactive systems (2006), 301--310
23. Landgren, J. Making action visible in time-critical work. In Proc. CHI 2006, ACM Press (2006), 201--210
24. Landgren, J and Nulden, U. A study of emergency response work: Patterns of mobile Phone Interaction. In Proc. CHI 2004, ACM Press (2007), 1323--1332
25. Marcus, A. & Gasperini, J. Almost dead on arrival: a case study of non-user-centered design for a police emergency-response system. Interactions 13(5), ACM Press (2006). 12--18
26. Mogensen, P., & Trigg, R. H. (1992). Artefacts as triggers for participatory design. In Proc. Participatory Design Conference 1992, 55--62
27. Orlikowski, W. J. The Duality of Technology: Rethinking the Concept of Technology in Organizations. Organization Science 3(3), (1992), pp. 398--427
28. Orr, J. Talking about Machines: An Ethnography of a Modern Job. Cornell University Press, Ithaca, NY (1996).
29. Pan, Z. and Ngo, C. Structuring Home Video by Snippet Detection and Pattern Parsing. In Proc. MIR'04, ACM Press (2004), 69--76
30. Perry, M., Juhlin, O., Esbjörnsson, M., Engstrom, A. Lean Collaboration Through Video Gestures: Coordinating the production of live televised sport. In Proc. CHI 2007, ACM Press (2009), 2279--2288
31. Pica, D. & Sorensen, C. (2005). Tales from the police: Rhythms of interaction with mobile technologies. Information and Organization, 15(2), 125--149.
32. Puikkonen, A., Häkkilä, J., Ballagas, R., and Mäntyjärvi, J. Practices in creating videos with mobile phones. In Proc. MobileHCI 2009. ACM Press (2009), 1--10
33. Turoff, M., Chumer, M., Van de Walle, B., Yao, X. (2004) The Design of Emergency Response Management Information Systems. JITTA, 5(4), 1--35
34. Weick, K. E. Cosmos vs. Chaos: Sense and nonsense in electronic contexts. Organizational Dynamics (1985), 51--64
35. Whittaker, S. and Amento, B. Seeing What You Are Hearing. In Proc. ECSCW 2003, ACM Press (2003), 219--238
36. Whittaker, S. Things to Talk About When Talking About Things. Human-Computer Interaction (2003), 18(1), 149--170.
37. Yan, W. and Kankanhalli M. S. Detection and Removal of Lighting & Shaking Artifacts in Home Videos. In Proc. Multimedia'02, ACM Press (2002), 107--116.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

        • Video segmentation

      • Computer vision tasks

        • Video summarization

      • Image and video acquisition

• Human-centered computing

  • Collaborative and social computing

    • Collaborative and social computing theory, concepts and paradigms

      • Computer supported cooperative work

  • Human computer interaction (HCI)

    • HCI design and evaluation methods

  • Interaction design

    • Interaction design process and methods

      • Interface design prototyping

• Social and professional topics

  • Professional topics

    • Computing and business

      • Computer supported cooperative work