Anna Luusua
ABSTRACT
We introduce evaluation probes for conducting emic, experiential evaluation of urban technologies "in the wild" without direct researcher presence. We commence with a thorough discussion and analysis of the original cultural probes, used by Gaver, Dunne and Pacenti to gain design inspiration, and their subsequent variations. We develop the concept of evaluation probes through careful re-conceptualization and application of the cultural probes in three successive studies conducted in the wild. We recount and reflect on our use of evaluation probes and discuss their merits and limitations in experiential emic evaluation.
- Bardzell, J. and Bardzell, S. A great and troubling beauty: cognitive speculation and ubiquitous computing. Personal and Ubiquitous Computing 18, 4 (2014), 779--794. Google Scholar
Digital Library
- Bargas-Avila, J. A. and Hornbæk, K. Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience. In Proc. CHI 2011, ACM Press (2011), 2689--2698. Google ScholarDigital Library
- Bodley, J. H. Cultural anthropology: Tribes, states, and the global system. Altamira Press, Lanham, 2011.Google Scholar
- Boehner, K., Vertesi, J., Sengers, P. and Dourish, P. How HCI interprets the probes. In Proc. CHI 2007, ACM Press (2007), 1077--1086. Google ScholarDigital Library
- de Bono, E. Lateral Thinking. Penguin Books, London, 1990.Google Scholar
- Bryman, A. Social research methods. Oxford University Press, 2012.Google Scholar
- Chamberlain, A., Crabtree, A., Rodden, T., Jones, M. and Rogers, Y. Research in the wild: understanding 'in the wild' approaches to design and development. In Proc. DIS 2012, ACM Press (2012), 795--796. Google ScholarDigital Library
- Clarke, A. J. Design Anthropology: Object Culture in the 21st Century. Springer, 2011.Google ScholarCross Ref
- Cross, N. Designerly ways of knowing. Design Studies 3, 4 (1982), 221--227.Google ScholarCross Ref
- Danermark, B., ed. Explaining society: Critical realism in the social sciences. Routledge, London, 2002.Google Scholar
- Davies, C. Reflexive Ethnography: A Guide to Researching Selves and Others. Routledge, London, 1999.Google Scholar
- Denig, S. Multiple intelligences and learning styles: Two complementary dimensions. The Teachers College Record 106, 1 (2004), 96--111.Google ScholarCross Ref
- Dourish, P. and Bell, G. Divining a digital future: Mess and mythology in ubiquitous computing. MIT Press, Cambridge, 2011. Google ScholarCross Ref
- Downton, P. Design Research. RMIT University Press, Melbourne, 2003.Google Scholar
- Elliott, H. The use of diaries in sociological research on health experience. Sociological Research Online 2, 2 (1997). http://www.socresonline.org.uk/2/2/7.htmlGoogle ScholarCross Ref
- Galloway, A. Intimations of everyday life: Ubiquitous computing and the city. Cultural Studies 18, 2-3 (2004), 384--408.Google ScholarCross Ref
- Gaver, B., Dunne, T. and Pacenti, E. Design: Cultural probes. Interactions 6, 1 (1999), 21--29. Google ScholarDigital Library
- Gaver, W., Boucher, A., Pennington, S. and Walker, B. 2004. Cultural probes and the value of uncertainty. Interactions 11, 5 (2004), 53--56. Google ScholarDigital Library
- Graham, C., Cheverst, K. and Rouncefield, M. Whose probe is it anyway? Workshop on Appropriate Methods for Design in Complex and Sensitive Settings at OzCHI 2005.Google Scholar
- Groat, L. and Wang, D. Architectural Research Methods. Wiley, New York, 2002.Google Scholar
- Harrison, S., Sengers, P. and Tatar, D. Making epistemological trouble: Third-paradigm HCI as successor science. Interacting with Computers 23, 5 (2011), 385--392. Google ScholarDigital Library
- Harrison, S., Tatar, D. and Sengers, P. The three paradigms of HCI. alt. chi 2007.Google Scholar
- Hemmings, T., Crabtree, A., Rodden, T., Clarke, K. and Rouchefield, M. Probing the probes. In Proc. PDC 2002, ACM Press (2002), 42--50.Google Scholar
- Hogan, R. Engendered autobiographies: The diary as a feminine form. Prose Studies: History, Theory, Criticism 14, 2 (1991), 95--107.Google Scholar
- Hosio, S., Kostakos, V., Kukka, H., Jurmu, M., Riekki, J. and Ojala, T. From school food to skate parks in a few clicks: Using public displays to bootstrap civic engagement of the young. In Proc. Pervasive 2012, Springer (2012), 425--442. Google ScholarDigital Library
- Hutchinson, H., Mackay, W., Westerlund, B., Bederson, B., Druin, A., Plaisant, C., Beaudouin-Lafon, M., Conversy, C., Evans, H., Hansen, H., Roussel, N. and Eiderbäck, B. Technology probes: Inspiring design for and with families. In Proc. CHI 2003, ACM Press (2003), 17--24. Google ScholarDigital Library
- Keskinen, T., Hakulinen, J., Heimonen, T., Turunen, M., Sharma, S., Miettinen, T. and Luhtala, M. Evaluating the experiential user experience of public display applications in the wild. In Proc. MUM 2013, ACM Press (2013), Article 7. Google ScholarDigital Library
- Kindberg, T., Chalmers, M. and Paulos, E. Guest editors' introduction: Urban computing. IEEE Pervasive Computing 6, 3 (2007), 18--20. Google ScholarDigital Library
- Kukka, H., Luusua, A., Ylipulli, J., Suopajärvi, T., Kostakos, V. and Ojala, T. From cyberpunk to calm urban computing: Exploring the role of technology in the future cityscape. Technological Forecasting and Social Change 84 (2014), 29--42.Google ScholarCross Ref
- Kuutti, K. HCI and design - uncomfortable bedfellows' In Binder, T. Löwgren, J. and Malmborg, L. (Re)searching the Digital Bauhaus. Springer, London, 2009.Google Scholar
- Liu, Y., Goncalves, J., Ferreira, D., Xiao, B., Hosio, S. and Kostakos, V. CHI 1994--2013: Mapping two decades of intellectual progress through co-word analysis. In Proc. CHI 2014, ACM Press (2014), 3553--3562. Google ScholarDigital Library
- Marshall, P., Morris, R., Rogers, Y., Kreitmayer, S. and Davies, M. Rethinking 'multi-user': an in-the-wild study of how groups approach a walk-up-and-use tabletop interface. In Proc. CHI 2011, ACM Press, 3033--3042. Google ScholarDigital Library
- Mattelmäki, T. Design probes. Aalto University, Helsinki, 2006.Google Scholar
- Mattelmäki, T. and Battarbee, K. Empathy probes. In Proc. PDC 2002, ACM Press (2002), 266--271.Google Scholar
- Millen, D. R. Rapid ethnography: time deepening strategies for HCI field research. In Proc. DIS 2000, ACM Press (2000), 280--286. Google ScholarDigital Library
- Ojala, T., Kostakos, V., Kukka, H., Heikkinen, T., Linden, T., Jurmu, M., Kruger, F. and Zanni, D. Multipurpose interactive public displays in the wild: Three years later. Computer 45, 5 (2012), 42--49. Google ScholarDigital Library
- Paulos, E. and Jenkins, T. 2005. Urban probes: encountering our emerging urban atmospheres. In Proc. CHI 2005, ACM Press (2005), 341--350. Google ScholarDigital Library
- Pihlajaniemi, H., Luusua, A., Markkanen, P., Herneoja, A. and Pentikäinen, V. Experiencing Adaptive Retail Lighting in a Real-World Pilot. In Proc. Experiencing Light 2014, Eindhoven University of Technology (2014), 90--93.Google Scholar
- Pink, S. Doing Sensory Ethnography. Sage, London, 2009.Google ScholarCross Ref
- Polanyi, M. The Tacit Dimension. University of Chicago Press, 1966.Google Scholar
- Rogers, Y. Interaction design gone wild: striving for wild theory. Interactions 18, 4 (2011), 58--62. Google ScholarDigital Library
- Schön, D. The reflective practitioner: How professionals think in action. Basic books, 1983.Google Scholar
- Wallace, J., McCarthy, J., Wright, P. and Olivier, P. Making design probes work. In Proc. CHI 2013, ACM Press (2013), 3441--3450. Google ScholarDigital Library
- Ylipulli J., Luusua A., Kukka H. and Ojala, T. Winter is coming: Introducing climate sensitive urban computing. In Proc. DIS 2014, ACM Press (2014), 647--656. Google ScholarDigital Library
- Ylipulli, J., Suopajärvi, T., Ojala, T., Kostakos, V. and Kukka, H. Municipal WiFi and interactive displays: Appropriation of new technologies in public urban spaces. Technological Forecasting and Social Change 89 (2014), 145--160.Google ScholarCross Ref
- Ylipulli, J. and Suopajärvi, T. Contesting ubicomp visions through ICT practices: Power negotiations in the meshwork of a technologised city. International Communication Gazette 75, 5--6 (2013), 538--554.Google ScholarCross Ref
Index Terms
- Evaluation Probes
Recommendations
How HCI interprets the probes
CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe trace how cultural probes have been adopted and adapted by the HCI community. The flexibility of probes has been central to their uptake, resulting in a proliferation of divergent uses and derivatives. The varying patterns of adaptation of the probes ...
Making design probes work
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsProbes have been adopted with great enthusiasm in both Design and HCI. The heterogeneity with which they have been used in practice reflects how the method has proved elusive for many. Originators and commentators of probes have discussed ...
How Design Researchers Interpret Probes: Understanding the Critical Intentions of a Designerly Approach to Research
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsSince entering the HCI lexicon in the 1990s, Probes have been interpreted and used in divergent ways as a designerly approach to research. While originally positioned as a critique of dominant user-research methods, literature on Probes rarely reflects ...
Comments