NotifEye: using interactive glasses to deal with notifications while walking in public

ABSTRACT

In this paper we explore the use of interactive eyewear in public. We introduce NotifEye, an application that allows a person to receive social network notifications on interactive glasses while walking on a busy street. The prototype uses a minimalistic user interface (UI) for interactive glasses to help people focus their attention on their surroundings and supports discreet interaction by using a finger rub pad to take action on incoming notifications. We studied pragmatic and hedonic aspects of the prototype during a pedestrian navigation task in a city center. We found that, despite the potential risk of overwhelming people with information, participants were able to keep track of their surroundings as they dealt with incoming notifications. Participants also positively valued the use of a discreet device to provide input for interactive glasses. Finally, participants reflected on their (evolving) perception of interactive glasses, indicating that glasses should become smaller, more comfortable to wear, and somewhat of a fashion accessory.

References

1. Amft, O. and Lukowicz, P. From Backpacks to Smartphones: Past, Present, and Future of Wearable Computers. IEEE Pervasive Computing 8, 3 (2009), 8--13.
2. Ashbrook, D., Baudisch, P. and White, S. Nenya: subtle and eyes-free mobile input with a magnetically-tracked finger ring. Proc. CHI '11, ACM Press (2011), 2043--2046.
3. Baber, C. Wearable computers: A human factors review. Human--Computer Interaction 13, 2 (2001), 123--145.
4. Bailly, G., Müller, J., Rohs, R., Wigdor, D. and Kratz, S. ShoeSense: a new perspective on gestural interaction and wearable applications. Proc. CHI '12, ACM Press (2012), 1239--1248.
5. Bartram, L., Ware, C. and Calvert, T. Moticons: detection, distraction and task. Int. J. Hum.-Comput. Stud. 58, 5 (2003), 515--545.
6. Bergstrom-Lehtovirta, J., Oulasvirta, A. and Brewster, S. The effects of walking speed on target acquisition on a touchscreen interface. Proc. MobileHCI '11, ACM Press (2011), 143--146.
7. Billinghurst, M., Starner, T. Wearable devices: new ways to manage information. Computer 32, 1 (1999), 57--64.
8. Costanza, E., Inverso, S. A. and Allen, R. Toward subtle intimate interfaces for mobile devices using an EMG controller. Proc. CHI '05, ACM Press (2005), 481--489.
9. Costanza, E., Inverso, S. A., Pavlov, E., Allen, R. and Maes, P. eye-q: eyeglass peripheral display for subtle intimate notifications. Proc. MobileHCI '06, ACM (2006), 211--218.
10. Feiner, S., MacIntyre, B., Haupt, M. and Solomon, E. Windows on the world: 2D windows for 3D augmented reality. Proc. UIST '93, ACM Press (1993), 145--155.
11. Fischer, J. E., Yee, N., Bellotti, V., Good, N., Benford, S. and Greenhalgh, S. Effects of content and time of delivery on receptivity to mobile interruptions. Proc. MobileHCI '10, ACM Press (2010), 103--112.
12. Fischer, J. E., Greenhalgh, C. and Benford, S. Investigating episodes of mobile phone activity as indicators of opportune moments to deliver notifications. Proc. MobileHCI '11, ACM Press (2011), 181--190.
13. Gabbard, J. L., Swan, J. E., Zedlitz, J. and Winchester, W. W. More than meets the eye: An engineering study to empirically examine the blending of real and virtual color spaces. Proc. VR '10, IEEE (2010), 79--86.
14. Gemperle, F., Kasabach, C., Stivoric, J., Bauer, M. and Martin, R. Design for Wearability. Proc. ISWC '98, IEEE (1998), 116--122.
15. Goffman, E. The Presentation of Self in Everyday Life. Penguin Books, 1990.
16. Hassenzahl, M. The interplay of beauty, goodness, and usability in interactive products. Human-Computer Interaction 19, 4 (2004), 319--349.
17. Ho, J. and Intille, S. S. Using context-aware computing to reduce the perceived burden of interruptions from mobile devices. Proc. CHI '05, ACM Press (2005), 909--918.
18. Horvitz, E., Koch, P. and Apacible, J. BusyBody: creating and fielding personalized models of the cost of interruption. Proc. CSCW '04, ACM Press (2004), 507--510.
19. Iqbal, S. and Bailey, B. P. Leveraging characteristics of task structure to predict the cost of interruption. Proc. CHI '06, ACM Press (2006), 741--750.
20. Kawakita, J. The original KJ method. Tokyo: Kawakita Research Institute, 1991.
21. Kerr, S. J., Rice, M. D., Teo, Y., Wan, M., Cheong, Y. L., Ng, J., Ng-Thamrin, L., Thura-Myo, T. and Wren, D. Wearable mobile augmented reality: evaluating outdoor user experience. Proc. VRCAI '11, ACM (2011), 209--216.
22. Kortuem, G., Schneider, J., Preuitt, D., Thompson, T. G. C., Fickas, S. and Segall, Z. When Peer-to-Peer comes Face-to-Face: Collaborative Peer-to-Peer Computing in Mobile Ad hoc Networks. Proc. P2P '01, IEEE (2001), 75--91.
23. Lucero, A. and Arrasvuori, J. PLEX Cards: a source of inspiration when designing for playfulness. Proc. Fun and Games '10, ACM Press (2010), 28--37.
24. Lucero, A., Holopainen, J. and Jokela, T. Pass-them-around: collaborative use of mobile phones for photo sharing. Proc. CHI '11, ACM Press (2011), 1787--1796.
25. Lucero, A., Holopainen, J. and Jokela, T. MobiComics: collaborative use of mobile phones and large displays for public expression. Proc. MobileHCI '12, ACM Press (2012), 383--392.
26. Lucero, A., Lyons, K., Vetek, A., Järvenpää, T., White, S., Salmimaa, M. Exploring the interaction design space for interactive glasses. CHI EA '13, ACM (2013), 1341--1346.
27. Lyons, K., Nguyen, D., Ashbrook, D. and White, S. Facet: a multi-segment wrist worn system. Proc. UIST '12, ACM Press (2012), 123--130.
28. Mann, S. Wearable Computing-Toward Humanistic Intelligence. IEEE Intelligent Systems 16, 3 (2001), 10--15.
29. McAtamney, G. and Parker, C. An examination of the effects of a wearable display on informal face-to-face communication. Proc. CHI '06, ACM Press (2006), 45--54.
30. McCullough, M. On attention to surroundings. interactions 19, 6 (2012), 40--49.
31. McFarlane, D. Coordinating the interruption of people in human-computer interaction. Proc. INTERACT '99, IOS Press, (1999), 295--303.
32. Mistry, P., Maes, P. and Chang, L. WUW - wear Ur world: a wearable gestural interface. Proc. CHI EA '09, ACM Press (2009), 4111--4116.
33. Montero, C. S., Alexander, J., Marshall, M. T. and Subramanian, S. Would you do that?: understanding social acceptance of gestural interfaces. Proc. MobileHCI '10, ACM Press (2010), 275--278.
34. Mustonen, T., Berg, M., Kaistinen, J., Kawai, T. and Häkkinen, J. Visual task performance using a monocular see-through head-mounted display (HMD) while walking. Journal of Experimental Psychology 19, 4 (2013), 333--344.
35. Oulasvirta, A., Tamminen, S., Roto, V. and Kuorelahti, J. Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI. Proc. CHI '05, ACM Press (2005), 919--928.
36. Pingel, T. J. and Clarke, K. C. Assessing the usability of a wearable computer system for outdoor pedestrian navigation. Autocarto ACSM (2005).
37. Pirhonen, A., Brewster, S. and Holguin, C. Gestural and audio metaphors as a means of control for mobile devices. Proc. CHI '02, ACM Press (2002), 291--298.
38. Reeves, S., Benford, S., O'Malley, C. and Fraser, M. Designing the spectator experience. Proc. CHI '05, ACM Press (2005), 741--750.
39. Rekimoto, J. GestureWrist and GesturePad: Unobtrusive Wearable Interaction Devices. Proc. ISWC '01, IEEE (2001), 21--27.
40. Rico, J. and Brewster, S. Usable gestures for mobile interfaces: evaluating social acceptability. Proc. CHI '10, ACM Press (2010), 887--896.
41. Saponas, T. S., Harrison, C. and Benko, H. PocketTouch: through-fabric capacitive touch input. Proc. UIST '11, ACM Press (2011), 303--308.
42. Siewiorek, D., Smailagic, A. and Starner, T. Wearable computers. Chapter 15. In The human-computer interaction handbook, 2^nd Edition, 2008.
43. Starner, T., Mann, S., Rhodes, B., Levine, J., Healey, J., Kirsch, D., Picard, R. and Pentland, A. Augmented reality through wearable computing. Presence: Teleoperators and Virtual Environments 6, 4 (1997), 386--398.
44. Stellmach, S. and Dachselt, R. Look & touch: gaze-supported target acquisition. Proc. CHI '12, ACM Press (2012), 2981--2990.
45. Thomas, B. H. and Piekarski, W. Glove based user interaction techniques for augmented reality in an outdoor environment. Virtual Reality 6 (2002), 167--180.
46. Williamson, J. R., Crossan, A. and Brewster, S. Multimodal mobile interactions: usability studies in real world settings. Proc. ICMI '11, ACM Press (2011), 361--368.

Index Terms

• Human-centered computing