Play it by ear: a case for serendipitous discovery of places with musicons

ABSTRACT

Current location-based services (LBS) typically allow users to locate points of interest (POI) in their vicinity but can detract from the user's emotional experience of exploring a new location. In this paper, we examine how cues in the form of popular music (musicons) can emotionally engage users and enhance their experience of discovering nearby POIs serendipitously in unfamiliar places. The primary contribution of this paper is a field study, in which we evaluate the performance and emotional engagement of different types of audio-based cues for directing users' attention to specific POIs. Musicons and mixed-modality cues performed close to visual and speech cues, and significantly better than auditory icons, for POI identification while creating a much more pleasant and engaging user experience. We conclude that cues for POI discovery need not always be as explicit as the baseline visual cues. Indeed, the most challenging cues, auditory icons, led to a heightened sense of autonomy.

References

1. Agarwal, A., and Meyer, A. Beyond usability: Evaluating emotional response as an integral part of the user experience. In CHI '09, ACM (2009), 2919--2930.
2. Alty, J. L., and Rigas, D. I. Communicating graphical information to blind users using music: the role of context. In CHI '98, ACM Press/Addison-Wesley Publishing Co. (New York, NY, USA, 1998), 574--581.
3. Ankolekar, A., and Sandholm, T. Foxtrot: a soundtrack for where you are. In Proceedings of Interacting with Sound, workshop at MobileHCI '11, IwS '11, ACM (New York, NY, USA, 2011), 26--31.
4. Bull, M. Sound moves: iPod culture and urban experience. Routledge, 2008.
5. Denora, T. Music in everyday life. Cambridge University Press, 2000.
6. Garzonis, S., Jones, S., Jay, T., and O'Neill, E. Auditory icon and earcon mobile service notifications: intuitiveness, learnability, memorability and preference. In CHI '09, ACM (New York, NY, USA, 2009), 1513--1522.
7. Goodman, J., Brewster, S., and Gray, P. Using field experiments to evaluate mobile guides. In Proc. of HCI in Mobile Guides, workshop at Mobile HCI 2004 (2004).
8. Goodman, J., Brewster, S. A., and Gray, P. How can we best use landmarks to support older people in navigation? Journal of Behaviour and Information Technology 24 (2005), 3--20.
9. Holland, S., Morse, D. R., and Gedenryd, H. Audiogps: Spatial audio navigation with a minimal attention interface. Personal Ubiquitous Comput. (Jan. 2002), 253--259.
10. Johnson, F. D. The effects of music on temporary disposition (unpublished manuscript), 2001.
11. Jones, M., Jones, S., Bradley, G., Warren, N., Bainbridge, D., and Holmes, G. Ontrack: Dynamically adapting music playback to support navigation. Personal Ubiquitous Comput. 12 (October 2008), 513--525.
12. Kurczak, J., Graham, T. C. N., Joly, C., and Mandryk, R. L. Hearing is believing: evaluating ambient audio for location-based games. In ACE '11, ACM (New York, NY, USA, 2011), 32:1--32:8.
13. McGee-Lennon, M., Wolters, M., McLachlan, R., Brewster, S., and Hall, C. Name that tune: musicons as reminders in the home. In CHI '11, ACM (New York, NY, USA, 2011), 2803--2806.
14. McGookin, D., and Brewster, S. Pulse: an auditory display to provide a social vibe. In Proceedings of Interacting with Sound, workshop at MobileHCI '11, IwS '11, ACM (New York, NY, USA, 2011), 12--15.
15. Mcgookin, D., Brewster, S., and Priego, P. Audio bubbles: Employing non-speech audio to support tourist wayfinding. In HAID '09, Springer-Verlag (Berlin, Heidelberg, 2009), 41--50.
16. Mehrabian, A., and Russell, J. A. An approach to environmental psychology. M.I.T. Press, Cambridge, MA, USA, 1974.
17. Raper, J., Gartner, G., Karimi, H., and Rizos, C. A critical evaluation of location based services and their potential. Journal of Location Based Services 1, 1 (2007), 5--45.
18. Robinson, S., Jones, M., Williamson, J., Murray-Smith, R., Eslambolchilar, P., and Lindborg, M. Navigation your way: from spontaneous independent exploration to dynamic social journeys. Personal Ubiquitous Comput. (Sept. 2011), 1--13.
19. Roe, K. Swedish Youth and Music: Listening Patterns and Motivations. Communication Research 12 (July 1985), 353--362.
20. Rueb, T. Trace. Yoho National Park, Canada, 1999.
21. Scherer, K. R., and Zentner, M. K. Emotional Effects of Music: production rules. Oxford University Press, 2001, ch. Music and Emotion: Theory and Research, 361--392.
22. Sikora, C. A., Roberts, L., and Murray, L. T. Musical vs. real world feedback signals. In CHI '95, ACM (New York, NY, USA, 1995), 220--221.
23. Stahl, C. The roaring navigator: a group guide for the zoo with shared auditory landmark display. In MobileHCI '07, ACM (New York, NY, USA, 2007), 383--386.
24. Strachan, S., Eslambolchilar, P., Murray-Smith, R., Hughes, S., and O'Modhrain, S. Gpstunes: controlling navigation via audio feedback. In MobileHCI '05, ACM (New York, NY, USA, 2005), 275--278.
25. Warren, N., Jones, M., Jones, S., and Bainbridge, D. Navigation via continuously adapted music. In CHI EA '05, ACM (New York, NY, USA, 2005), 1849--1852.
26. Wobbrock, J. O., Findlater, L., Gergle, D., and Higgins, J. J. The aligned rank transform for nonparametric factorial analyses using only anova procedures. In CHI '11, ACM (New York, NY, USA, 2011), 143--146.

Index Terms

• Human-centered computing